User Tools

Site Tools


start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start [2014/09/05 23:55]
edseidewitz
start [2016/12/21 10:54] (current)
edseidewitz [How to Use the Vendor-Provided Test Submissions]
Line 6: Line 6:
    * establish a demonstration infrastructure to support the above, including validation tools, demonstration processes and guidelines    * establish a demonstration infrastructure to support the above, including validation tools, demonstration processes and guidelines
  
-Beginning in December 2008, the MIWG has defined a [[start#​Test Suite|test suite]] of 40 test cases to demonstrate interchange of UML, SysML, SoaML and UPDM models between different modeling tools. Participating tool vendors have agreed to publicly post XMI exports from their tools for the MIWG test cases. ​ The objective is to enable the public at large to assess model interchange capability of the modeling tools by comparing the vendor XMI exports to the expected reference XMI file for each test case. These assessments may be used for a variety of purposes, including:+Beginning in December 2008, the MIWG has defined a [[start#​Test Suite|test suite]] of 48 test cases to demonstrate interchange of UML, SysML, SoaML and UPDM models between different modeling tools. Participating tool vendors have agreed to publicly post XMI exports from their tools for the MIWG test cases. ​ The objective is to enable the public at large to assess model interchange capability of the modeling tools by comparing the vendor XMI exports to the expected reference XMI file for each test case. These assessments may be used for a variety of purposes, including:
  
    * Evaluation of the interchange capability of a particular tool as part of a tool selection process ​    * Evaluation of the interchange capability of a particular tool as part of a tool selection process ​
Line 12: Line 12:
  
 The test suite and guidance for how to assess interchange capability using this test suite are summarized below. Please send any questions or requests for further information to [[[email protected]]]. The test suite and guidance for how to assess interchange capability using this test suite are summarized below. Please send any questions or requests for further information to [[[email protected]]].
- 
- 
- 
- 
- 
- 
  
 ====== Quick Links ====== ====== Quick Links ======
    * [[start#​Test Suite]]    * [[start#​Test Suite]]
-   * [[https://dev.enterprisecomponent.com/​repository/​repos/​OMG-Model-Interchange/​branches/​Public/​Tests/​|Vendor Test Submission Repository]] (Username: guest/​Password:​ guest) (see also [[start#How to Use the Vendor-Provided Test Submissions]])+   * [[http://svn.omg.org/​repos/​OMG-Model-Interchange/​branches/​Public/​Tests/​|Vendor Test Submission Repository]] (Username: guest/​Password:​ guest) (see also [[start#How to Use the Vendor-Provided Test Submissions]])
    * [[http://​validator.omg.org/​se-interop/​tools/​validator|NIST Validator]] (see also [[start#How to Use the NIST Validator to Assess Model Interchange]])    * [[http://​validator.omg.org/​se-interop/​tools/​validator|NIST Validator]] (see also [[start#How to Use the NIST Validator to Assess Model Interchange]])
-   * {{MIWG-roadmap-120116-reva-draft-sf.ppt|Roadmap}} 
    * [[MIWGInternal|MIWG Internal Wiki]]    * [[MIWGInternal|MIWG Internal Wiki]]
  
Line 34: Line 27:
 ====== Participating Tool Vendors ====== ====== Participating Tool Vendors ======
  
-^ Vendor ​       ^ Point of Contact ​           ^ Tool                       ^ Version ​+^ Vendor ​       ^ Point of Contact ​           ^ Tool                       ^ 
-| Atego         ​| Simon Moore                 | Artisan<​sup>​®</​sup>​ Studio ​| 7.2m    ​+PTC (Atego)   | Simon Moore                 | Artisan<​sup>​®</​sup>​ Studio | 
-| IBM           ​| ​Maged Elaasar ​              | RSx                        ​| 8.0.3   +| IBM           ​| ​                            ​| RSx                        | 
-| IBM/​Sodius ​   | Eldad Palachi/​Mickael Albert| IBM Rhapsody ​              | 7.6.x   +| IBM/​Sodius ​   | Eldad Palachi/​Mickael Albert| IBM Rhapsody ​              | 
-| No Magic      | Lonnie VanZandt ​            | MagicDraw ​                 ​| 17.0    ​+| No Magic      | Nerijus Jankevicius ​        | MagicDraw ​                 | 
-| SOFTEAM ​      | Etienne Brosse ​             | Modelio ​                   ​| 2.4.19  ​+| SOFTEAM ​      | Etienne Brosse ​             | Modelio ​                   | 
-| Sparx Systems | J. D. Baker                 | Enterprise Architect ​      ​| ​9.1     |+| Sparx Systems | J. D. Baker                 | Enterprise Architect ​      | 
  
 ====== Other Participants ====== ====== Other Participants ======
  
-   * Roy Bell, Raytheon (MIWG Co-Chair) 
    * Peter Denno, NIST (Validator)    * Peter Denno, NIST (Validator)
-   * Sandy Friedenthal,​ SAF Consulting ​(MIWG Chair)+   * Sandy Friedenthal,​ SAF Consulting
    * Leonard Levine, DISA    * Leonard Levine, DISA
    * Pete Rivett, Adaptive    * Pete Rivett, Adaptive
-   * Ed Seidewitz, Model Driven Solutions+   * Ed Seidewitz, ​nMeta (Model Interchange SIG Chair) 
  
 ====== Test Suite ====== ====== Test Suite ======
  
-The MIWG Test Suite currently consists of 40 test cases. ​Twenty-five ​of these are for UML 2.3, some of which are also applicable to SysML, ​ten are for SysML 1.(one test case has both a UML and a SysML form), one is for SoaML 1.0.1 (this test case also has a UML form) and four are for UPDM 2.0. These test cases cover approximately ​83% of UML metaclasses and 100% of SysML stereotypes. (For a spreadsheet showing detailing this coverage, click {{uml-and-sysml-coverage-reports.xlsx|here}}.)+The MIWG Test Suite currently consists of 48 test cases. ​Thirty ​of these are for UML 2.4.1 (twenty-five have UML 2.3 versions), some of which are also applicable to SysML, ​thirteen ​are for SysML 1.(ten have SysML 1.2 versions), one is for SoaML 1.0.1 and four are for UPDM 2.0.1. These test cases cover approximately ​94% of UML metaclasses ​(for UML 2.4.1) ​and 100% of SysML stereotypes ​(for SysML 1.3, not including deprecated stereotypes). (For a spreadsheet showing detailing this coverage, click {{uml-and-sysml-coverage-reports-updated-2.xlsx|here}}.)
  
-Each test case consists of one or more diagrams and a corresponding reference "valid XMI" file for the model represented in the diagrams (for Test Case 3 and 19 there are two XMI files). All XMI conforms to v2.1 of the XMI specification.+Each test case consists of one or more diagrams and a corresponding reference "valid XMI" file for the model represented in the diagrams (for Test Case 3 and 19 there are two XMI files). All XMI conforms to either ​v2.1 of the XMI specification ​(for UML 2.3, SysML 1.2, SoaML 1.0.1 and UPDM 2.0.1) or v2.4.1 (for UML 2.4.1 and SysML 1.3).
  
-===== UML 2.3 Test Cases ===== +===== UML Test Cases ===== 
-      * [[Test Case 1 UML 2.3|Test Case 1]] - Simple Class Model +      * Test Case 1 ([[Test Case 1 UML 2.4|UML 2.4.1]]) ([[Test Case 1 UML 2.3|UML 2.3]]- Simple Class Model 
-      * [[Test Case 2 UML 2.3|Test Case 2]] - Advanced Class Model +      * Test Case 2 ([[Test Case 2 UML 2.4|UML 2.4.1]]) ([[Test Case 2 UML 2.3|UML 2.3]]- Advanced Class Model 
-      * [[Test Case 3 UML 2.3|Test Case 3]] - Definition and Application of Profile* +      * Test Case 3 ([[Test Case 3 UML 2.4|UML 2.4.1]]) ([[Test Case 3 UML 2.3|UML 2.3]]- Definition and Application of Profile* 
-      * [[Test Case 4 UML 2.3|Test Case 4]] - Simple Activity Model (fUML subset - executable)* +      * Test Case 4 ([[Test Case 4 UML 2.4|UML 2.4.1]]) ([[Test Case 4 UML 2.3|UML 2.3]]- Simple Activity Model (fUML subset - executable)* 
-      * [[Test Case 5 UML 2.3|Test Case 5]] - Advanced Activity Model (fUML subset - executable)* +      * Test Case 5 ([[Test Case 5 UML 2.4|UML 2.4.1]]) ([[Test Case 5 UML 2.3|UML 2.3]]- Advanced Activity Model (fUML subset - executable)* 
-      * [[Test Case 6 UML 2.3|Test Case 6]] - Composite Structure +      * Test Case 6 ([[Test Case 6 UML 2.4|UML 2.4.1]]) ([[Test Case 6 UML 2.3|UML 2.3]]- Composite Structure 
-      * [[Test Case 7 UML 2.3|Test Case 7]] - State Machines* +      * Test Case 7 ([[Test Case 7 UML 2.4|UML 2.4.1]]) ([[Test Case 7 UML 2.3|UML 2.3]]- State Machines* 
-      * [[Test Case 8 UML 2.3|Test Case 8]] - Use Cases* +      * Test Case 8 ([[Test Case 8 UML 2.4|UML 2.4.1]]) ([[Test Case 8 UML 2.3|UML 2.3]]- Use Cases* 
-      * [[Test Case 9 UML 2.3|Test Case 9]] - Interactions* +      * Test Case 9 ([[Test Case 9 UML 2.4|UML 2.4.1]]) ([[Test Case 9 UML 2.3|UML 2.3]]- Interactions* 
-      * [[Test Case 12b UML 2.3|Test Case 12b]] - Activity Swim Lanes +      * Test Case 12b ([[Test Case 12b UML 2.4|UML 2.4.1]]) ([[Test Case 12b UML 2.3|UML 2.3]]- Activity Swim Lanes 
-      * [[Test Case 13 UML 2.3|Test Case 13]] - Instance Specifications +      * Test Case 13 ([[Test Case 13 UML 2.4|UML 2.4.1]]) ([[Test Case 13 UML 2.3|UML 2.3]]- Instance Specifications 
-      * [[Test Case 15 UML 2.3|Test Case 15]] - Structured Activity Nodes +      * Test Case 15 ([[Test Case 15 UML 2.4|UML 2.4.1]]) ([[Test Case 15 UML 2.3|UML 2.3]]- Structured Activity Nodes 
-      * [[Test Case 17b UML 2.3| Test Case 17b]] - Collaborations +      * Test Case 17b ([[Test Case 17b UML 2.4|UML 2.4.1]]) ([[Test Case 17b UML 2.3|UML 2.3]]- Collaborations 
-      * [[Test Case 19 UML 2.3| Test Case 19]] - Simple Model Federation +      * Test Case 19 ([[Test Case 19 UML 2.4|UML 2.4.1]]) ([[Test Case 19 UML 2.3|UML 2.3]]- Simple Model Federation 
-      * [[Test Case 23 UML 2.3| Test Case 23]] - Components and Component Realization +      * Test Case 23 ([[Test Case 23 UML 2.4|UML 2.4.1]]) ([[Test Case 23 UML 2.3|UML 2.3]]- Components and Component Realization 
-      * [[Test Case 24 UML 2.3| Test Case 24]] - Components: Ball-and-Socket Notation +      * Test Case 24 ([[Test Case 24 UML 2.4|UML 2.4.1]]) ([[Test Case 24 UML 2.3|UML 2.3]]- Components: Ball-and-Socket Notation 
-      * [[Test Case 25 UML 2.3| Test Case 25]] - Deployments +      * Test Case 25 ([[Test Case 25 UML 2.4|UML 2.4.1]]) ([[Test Case 25 UML 2.3|UML 2.3]]- Deployments 
-      * [[Test Case 26 UML 2.3| Test Case 26]] - Classifier Templates +      * Test Case 26 ([[Test Case 26 UML 2.4|UML 2.4.1]]) ([[Test Case 26 UML 2.3|UML 2.3]]- Classifier Templates 
-      * [[Test Case 27 UML 2.3| Test Case 27]] - Activities: Data Store Related +      * Test Case 27 ([[Test Case 27 UML 2.4|UML 2.4.1]]) ([[Test Case 27 UML 2.3|UML 2.3]]- Activities: Data Store Related 
-      * [[Test Case 28 UML 2.3| Test Case 28]] - Parameter Sets +      * Test Case 28 ([[Test Case 28 UML 2.4|UML 2.4.1]]) ([[Test Case 28 UML 2.3|UML 2.3]]- Parameter Sets 
-      * [[Test Case 29 UML 2.3| Test Case 29]] - Additional Invocation-Related Actions +      * Test Case 29 ([[Test Case 29 UML 2.4|UML 2.4.1]]) ([[Test Case 29 UML 2.3|UML 2.3]]- Additional Invocation-Related Actions 
-      * [[Test Case 30 UML 2.3| Test Case 30]] - Sequenced Actions +      * Test Case 30 ([[Test Case 30 UML 2.4|UML 2.4.1]]) ([[Test Case 30 UML 2.3|UML 2.3]]- Sequenced Actions 
-      * [[Test Case 31 UML 2.3| Test Case 31]] - Variable-Related Actions +      * Test Case 31 ([[Test Case 31 UML 2.4|UML 2.4.1]]) ([[Test Case 31 UML 2.3|UML 2.3]]- Variable-Related Actions 
-      * [[Test Case 32 UML 2.3| Test Case 32]] - Link-Object-Related Actions +      * Test Case 32 ([[Test Case 32 UML 2.4|UML 2.4.1]]) ([[Test Case 32 UML 2.3|UML 2.3]]- Link-Object-Related Actions 
-      * [[Test Case 33 UML 2.3| Test Case 33]] - Classification and Reduction Actions +      * Test Case 33 ([[Test Case 33 UML 2.4|UML 2.4.1]]) ([[Test Case 33 UML 2.3|UML 2.3]]- Classification and Reduction Actions 
-      * Test Case 34 - (Reserved for future use)+      * Test Case 34 ([[Test Case 34 UML 2.4|UML 2.4.1]]) ​Interactions:​ Fragments 
 +      * Test Case 44 ([[Test Case 44 UML 2.4|UML 2.4.1]]- Interactions:​ Interaction Use 
 +      * Test Case 45 ([[Test Case 45 UML 2.4|UML 2.4.1]]) - Timing 
 +      * Test Case 46 ([[Test Case 46 UML 2.4|UML 2.4.1]]) - Imports and Dependencies 
 +      * Test Case 47 ([[Test Case 47 UML 2.4|UML 2.4.1]]) - Information Flows
 (* These test cases are also applicable to SysML.) (* These test cases are also applicable to SysML.)
  
-===== SysML 1.2 Test Cases ===== +===== SysML Test Cases ===== 
-      * [[Test Case 10 SysML 1.2|Test Case 10]] - Simple SysML Structure (BDDs and IBDs) +      * Test Case 10 ([[Test Case 10 SysML 1.3|SysML 1.3]]) ([[Test Case 10 SysML 1.2|SysML 1.2]]- Simple SysML Structure (BDDs and IBDs) 
-      * [[Test Case 11 SysML 1.2|Test Case 11]] - Requirements +      * Test Case 11 ([[Test Case 11 SysML 1.3|SysML 1.3]]) ([[Test Case 11 SysML 1.2|SysML 1.2]]- Requirements 
-      * [[Test Case 12a SysML 1.2|Test Case 12a]] - Activity Swim Lanes +      * Test Case 12a ([[Test Case 12a SysML 1.3|SysML 1.3]]) ([[Test Case 12a SysML 1.2|SysML 1.2]]- Activity Swim Lanes 
-      * [[Test Case 14 SysML 1.2|Test Case 14]] - Parametrics (including Value Types with Units) +      * Test Case 14 ([[Test Case 14 SysML 1.3|SysML 1.3]]) ([[Test Case 14 SysML 1.2|SysML 1.2]]- Parametrics (including Value Types with Units) 
-      * [[Test Case 16 SysML 1.2|Test Case 16]] - Allocations +      * Test Case 16 ([[Test Case 16 SysML 1.3|SysML 1.3]]) ([[Test Case 16 SysML 1.2|SysML 1.2]]- Allocations 
-      * [[Test Case 35 SysML 1.2|Test Case 35]] - Views and Viewpoints +      * Test Case 35 ([[Test Case 35 SysML 1.3|SysML 1.3]]) ([[Test Case 35 SysML 1.2|SysML 1.2]]- Views and Viewpoints 
-      * [[Test Case 36 SysML 1.2|Test Case 36]] - Blocks and Properties (Advanced) +      * Test Case 36 ([[Test Case 36 SysML 1.3|SysML 1.3]]) ([[Test Case 36 SysML 1.2|SysML 1.2]]- Blocks and Properties (Advanced) 
-      * [[Test Case 37 SysML 1.2|Test Case 37]] - Requirements (Advanced) +      * Test Case 37 ([[Test Case 37 SysML 1.3|SysML 1.3]]) ([[Test Case 37 SysML 1.2|SysML 1.2]]- Requirements (Advanced) 
-      * [[Test Case 38 SysML 1.2|Test Case 38]] - Activities (Advanced) +      * Test Case 38 ([[Test Case 38 SysML 1.3|SysML 1.3]]) ([[Test Case 38 SysML 1.2|SysML 1.2]]- Activities (Advanced) 
-      * [[Test Case 39 SysML 1.2|Test Case 39]] - Allocate Activity Partition +      * Test Case 39 ([[Test Case 39 SysML 1.3|SysML 1.3]]) ([[Test Case 39 SysML 1.2|SysML 1.2]]- Allocate Activity Partition 
- +      * Test Case 48 ([[Test Case 48 SysML 1.3|SysML ​1.3]]) - Full Ports 
-===== SoaML 1.0.Test Cases ===== +      * Test Case 49 ([[Test Case 49 SysML 1.3|SysML 1.3]]) - Nested Ports 
-      * [[Test Case 17a SoaML 1.0.1|Test Case 17a]] - Service Architecture+      * Test Case 50 ([[Test Case 50 SysML 1.3|SysML 1.3]]Directed Features
  
 +===== SoaML Test Cases =====
 +      * Test Case 17a ([[Test Case 17a SoaML 1.0.1|SoaML 1.0.1]]) - Service Architecture
  
-===== UPDM 2.0.1 Test Cases ===== +===== UPDM Test Cases ===== 
-      * [[Test Case 18 UPDM 2.0.1|Test Case 18]] - OV-2 Performer +      * Test Case 18 ([[Test Case 18 UPDM 2.0.1|UPDM 2.0.1]]- OV-2 Performer 
-      * [[Test Case 20 UPDM 2.0.1|Test Case 20]] - CV-1 Architectural Description +      * Test Case 20 ([[Test Case 20 UPDM 2.0.1|UPDM 2.0.1]]- CV-1 Architectural Description 
-      * [[Test Case 21 UPDM 2.0.1|Test Case 21]] - CV-2 Capability Taxonomy +      * Test Case 21 ([[Test Case 21 UPDM 2.0.1|UPDM 2.0.1]]- CV-2 Capability Taxonomy 
-      * [[Test Case 22 UPDM 2.0.1|Test Case 22]] - CV-4 Capability Dependencies+      * Test Case 22 ([[Test Case 22 UPDM 2.0.1|UPDM 2.0.1]]- CV-4 Capability Dependencies 
 +      * Test Case 40 - Reserved for future use 
 +      * Test Case 41 - Reserved for future use 
 +      * Test Case 42 - Reserved for future use 
 +      * Test Case 43 - Reserved for future use
  
 ====== How to Use the Vendor-Provided Test Submissions ====== ====== How to Use the Vendor-Provided Test Submissions ======
Line 114: Line 118:
 Each of the participating MIWG vendors have submitted results from the latest version of their tools for all the test cases that their tools support. These test submissions are maintained in a Subversion repository and may be updated from time to time to reflect new releases of the vendor tools. They can be used in two ways: Each of the participating MIWG vendors have submitted results from the latest version of their tools for all the test cases that their tools support. These test submissions are maintained in a Subversion repository and may be updated from time to time to reflect new releases of the vendor tools. They can be used in two ways:
  
-   - You can download a vendor submission for a test case from this repository at any time and run it through the [[http://syseng.nist.gov/​se-interop/​sysml/​validator|NIST Validator]] (as described below) in order to assess XMI conformance of the vendor'​s tool for this test case. +   - You can download a vendor submission for a test case from this repository at any time and run it through the [[http://validator.omg.org/​se-interop/​tools/​validator|NIST Validator]] (as described below) in order to assess XMI conformance of the vendor'​s tool for this test case. 
    - You can take submitted XMI for a test case exported from one tool and attempt to import it into a different tool, in order the assess the actual ability to interchange models between those tools in the area covered by the test case.    - You can take submitted XMI for a test case exported from one tool and attempt to import it into a different tool, in order the assess the actual ability to interchange models between those tools in the area covered by the test case.
  
-The public vendor test submission repository is available [[https://dev.enterprisecomponent.com/​repository/​repos/​OMG-Model-Interchange/​branches/​Public/​Tests/​|here]]. Log in using the user name //guest// with password //guest//.+The public vendor test submission repository is available [[http://svn.omg.org/​repos/​OMG-Model-Interchange/​branches/​Public/​Tests/​|here]]. Log in using the user name //guest// with password //guest//.
  
 The repository has two directories,​ UML2.3-XMI2.1 for UML tests and SysML1.2-XMI2.1 for SysML tests. Within these directories,​ there are subdirectories for each test case, with the following content: The repository has two directories,​ UML2.3-XMI2.1 for UML tests and SysML1.2-XMI2.1 for SysML tests. Within these directories,​ there are subdirectories for each test case, with the following content:
start.1409975731.txt.gz · Last modified: 2014/09/05 23:55 by edseidewitz