The SystemWeaver Test Solution provides test organizations with powerful tools for the many common test tasks such as creating tests from requirements, traceability, test execution, requirements coverage, test system management, test analysis and test scripts. And in SystemWeaver, it is all customizable. The views described in Working with the Test Solution do, however, depend on a specific meta model that is hard-coded. For the views to work properly, the SIDs listed in this article must be included in your meta model. Similarly, these SIDs should not be used for other item, part and attribute types in the database.
- Test Meta Model
- SIDs
- Extended Model SIDs
- Test Views
- Configuring Test Requirements Structure Tree View Setting
Test Meta Model and Example Data
Test Development
Example Data
Test Execution
Alternatively, using abstract types for Test Scope, Test Specification and Test case.
Example Data
SIDs
Below is a list of the above test and verification hard-coded SIDs for Item Types, Part Types, as well as the SIDs for Attribute Types. The names can be changed, but the SIDs must remain as specified here.
Item Types
| Test Suite | JBTE | A Test Suite represents one or many Tests. A Test Suite may include one or many sub Test Suites. This offers a flexible way of organizing many Tests, according aspects like different System under Test, different test runs or iterations, or tests performed by different organizations or persons. |
| Test | JSES | A Test represents a test of the System Under Test (SUT) as part of a Test System according to a Test Specification. The Test holds the result of the test as separate Test Status attribute values of each of the Test Cases included in the Test Specification. In addition to the Test Status there can be additional attributes, like comments on the outcome of each Test Case. |
| Test Specification | JTSP | The Test Specification (TS) contains a description about what and how something should be verified. The TS hold Test Cases and the connection to the Requirement Specification. The test that can be performed according to a TS is assumed to be possible to complete in an un-interrupted sequence. If this condition cannot be fulfilled, the TS should preferably be split into separate TSs. |
| Test Case | JTCS | This is a description on how something should be verified. It contains the Sequence(s) and can link to one or several requirements. |
| Abstract Artifact | AAR | This represents the System Under Test (Ii.e., the system or component that is being tested), or the Test System (i.e., the complete test environment, including the SUT, test equipment, adapters, already tested and integrated components etc.) that is being tested. Artifacts can inherit from this Abstract Artifact. |
| Artifact | IAR | This represents the System Under Test or Test System that is being tested. This can be an instance of Abstract Artifact. |
| Test Case Script | JTCA | A Test Case Script is a test case that can contain Test Scripts. |
| Test Script | JTSC | A set of instructions that will be performed on the system under test to test that the system functions as expected. It is a single behavior of a Test Case Script. |
| Test Scope | JTSD | A set of test cases that defines a “test project” organized as a set of test specifications. A test scope has a part relation called specification, which points to the item under test (scope). |
| Variant* | 10VA | For use with Variant Module. |
Part Types
| Name | SID | Owner | Defining Type (DefObj) |
| Sub-Test Suite | ISSS | JBTE | JBTE |
| Test | ISES | JBTE | JSES |
| Test Description | ISSP | JSES | JTSP |
| Test Case | ITEC | JTSP | JTCS |
| Test Specification Item | ITSI | JTSP | I |
| Test Specifications Requirements | ITTR | JTSP | RQ |
| Test Case Requirement | ITRQ | JTCS | RQ |
| Test Object | ISSU | JSES | AAR |
| Test System | IRTS | JSES | AAR |
| Test Scope | ISSC | JBTE | JTSD |
| Test Specification | ITTX | JTSD | JTSP |
| Specification | IBSF | JTSD | I |
| Sub Test Script | ISTS | JTSC | JTSC |
| Test Case Behavior | ITCB | JTCA | JTSC |
| Variant of* | TSVA | JTSP | JTSP |
| Exists for* | ITXF | JTCS | 10VA |
* Optional. For use with SystemWeaver's Feature Model and Variability model.
Attributes
| Name | SID | Object Assigned to | Type and Dimension |
| Test Case Status (i.e., the test result) | PTCS | Node attribute* | Enumeration, Single |
| Test Sequence list | TSQL | On Test Case (JTCS) | Custom, Single |
| Test Sequence Result List | TSRL | Node attribute on Test Case (JTCS)* | String, Single |
| Annotation | ABAN | Node attribute on Test Case (JTCS)* | String, Single |
| Development Status | DEST | ||
| Review Status | 3RST | ||
| Rvf Annotation (Long comment) | ARAN | Node attribute on Test Case (JTCS)* | |
| Test Procedure Sequence | TPSQ | ||
| Test Script Reference Deprecated | TSCR | On Test script (JTSC) | |
| Test Script Version | PTSV | On Test script (JTSC) | String, Single |
| Test Script Status | PTSS | On Test script (JTSC) | Enumeration, Single |
| Test Script Action | TSCA | On Test script (JTSC) | RVF, Single |
| Test Script Expected Result | TSCE | On Test script (JTSC) | RVF, Single |
| Test Script Result Comment | TSRC | Node attribute on Test Script (JTSC)** | Text, Single |
| Test Script Ref | TSRE | On Test script (JTSC) | Custom, Single |
* Requires the top node for Test in the context of Test Specification (i.e., TopNode/ISSP/ITEC if standing on a test case and using the Path Query language.
** Requires the context TopNode/ISSP/ITEC/ITCB.
Extended Model SIDs
Item Types
| Test Procedure | JSTP |
| Abstract Test Procedure | JATP |
| Formal Function List | JFFL |
Part Types
| Old Sub-Test Suite | ITSS |
| Sub Artifact | ISUA |
| Main Test Procedure | ISVP |
| Sub Test Procedure | IQTP |
| Abstract Test Procedure TC Alloc | IPTA |
| Controlled System | ISCT |
Hard-coded Test Views
A list of the available test views can be found in Configure the explorer. Activate the ones you would like to use in your test development and execution.
| View | Description | |
|---|---|---|
| Test Development | Requirements | Add and remove requirements to the test specification. |
Create test | Create new tests from test specifications. | |
| Test case editor | Edit description and test case sequences. | |
| Test case manager | Create test cases and add/remove requirements to them. | |
| Test configuration | Set test configuration and SUT (System Under Test). | |
| Test Execution | Coverage | View pie chart of requirement coverage and test case results. |
Result grid | View results in grid that supports grouping by column. Includes results at test case level. If you would like to have results display at test sequence level, you can configure a grid for this. | |
| Result history | View results from multiple tests or test suites in grid. | |
| Scope result | View results in grid that supports grouping by column. | |
| Test Protocol | Manage test results |
Other Test-related Add-ons
SystemWeaver also offers the following add-ons:
- A Create Test Plan extension viewsuitable for use when Test Cases or Test Scripts that can have parameters need to have their values specified before the actual tests are performed.
- An integration with vTESTStudio.
Required Structure Tree View Setting
To ensure that the Requirements and Coverage views in the solution work as expected, you will need to configure a "Test Requirements" structure tree view setting for the Test specification item type(s) in your test model.
To do this, open the Test specification item on a new tab so that it is the top-level item.
Then, click to expand the Structure tree view setting Edit menu and select Save active settings to new view.
Enter the name "Test Requirements" and click OK. (For more information on creating tree view settings, see Configuring Tree View Settings.)
| Note: The name of the new view must be "Test Requirements", i.e., exactly the same spelling and same case (upper and lower) of the letters. |
If the structure tree setting is not created, users will not see requirements listed in the views:
