cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:70_test
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:70_test [2022/05/11 15:30] nick |
cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:70_test [2022/06/17 19:46] (current) terrance |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ====== 6.11.5 Simulation, Training and Testing Environment ====== | + | ====== 6.11.7 Simulation, Training and Testing Environment ====== |
| - | [[cbdc:private:cbdc_omg:04_doc:90_recommend:93_recomend:start | Return to RDT&E]] | + | |< 100% >| |
| + | | [[cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:start| Return to RDT&E]] | <WRAP> | ||
| + | <html><b> | ||
| + | <a href="mailto:[email protected]?Subject=OMG's CBDC WG Response: | ||
| + | 6.11.7 Simulation, Training and Testing Environment | ||
| + | ">Provide Feedback</a></b> | ||
| + | </html> | ||
| + | </WRAP> | | ||
| - | The OMG members recommend the Federal Reserve invest [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:rtd_e | Research Development Test & Evaluation (RDT&E) Funding ]] in developing and perfecting a Simulation, Training, and Test environment. | + | The OMG's CBDC WG members recommend the Federal Reserve invest [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:rtd_e | Research Development Test & Evaluation (RDT&E) Funding ]] in developing and perfecting a Simulation, Training, and Test environment. |
| This environment should allow for the creation and running of thousands of Distributed Nodes of different types to simulate a real distributed environment in a matter of seconds or at most minutes. The Testing Environment (TE) needs to be able to start from a known starting point each time it is run, especially to support [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:regressiontesting | Regression Testing]]. | This environment should allow for the creation and running of thousands of Distributed Nodes of different types to simulate a real distributed environment in a matter of seconds or at most minutes. The Testing Environment (TE) needs to be able to start from a known starting point each time it is run, especially to support [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:regressiontesting | Regression Testing]]. | ||
| Line 10: | Line 17: | ||
| A Testing Environment (TE) can support simulation by allowing the morphology (number and kinds of nodes) of the Environment to be altered and rerun. Although the performance metrics collected during each run would not necessarily reflect the actual metrics during a real deployment, they would be useful relative to each other allowing for an informed decision-making process. | A Testing Environment (TE) can support simulation by allowing the morphology (number and kinds of nodes) of the Environment to be altered and rerun. Although the performance metrics collected during each run would not necessarily reflect the actual metrics during a real deployment, they would be useful relative to each other allowing for an informed decision-making process. | ||
| - | A Training Environment leverages the TE. The use of a Testing Environment offers some great opportunities for training people and AI on different well-known scenarios. | + | Training Environment leverages the TE by using the Testing Environment as a platform for training people and AI on different well-known scenarios. The TE would be started at a known point each time and the people or the intelligent agents could learn through the use of "what happens if" scenarios. The metrics collected could be used to assess the results. |
| - | Using a Testing Environment (TE) from the onset of the CBDC, helps fulfill the Non-Functional Requirement for Testability. | + | Using a Testing Environment (TE) from the onset of the CBDC helps fulfill the Non-Functional Requirement for Testability. |
| - | : **Note:** [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:t:testability | Testability]], Testable, Testing, and Test are not synonyms for each other. Just because a system or program is undergoing testing using various tests does not necessarily mean that the system or program is actually Testable. See section [[cbdc:private:cbdc_omg:04_doc:90_recommend:50_recomend:start]]. | + | : **Note:** [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:t:testability | Testability]], Testable, Testing, and Test are not synonyms for each other. Just because a system or program is undergoing testing using various tests does not necessarily mean that the system or program is actually Testable. See section [[cbdc:public:cbdc_omg:04_doc:90_recommend:50_recomend:start]]. |
| The following sections from the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra | OMG DIDO Reference Architecture (DIDO-RA)]] could be helpful in understanding the creation of a Test Environment. | The following sections from the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra | OMG DIDO Reference Architecture (DIDO-RA)]] could be helpful in understanding the creation of a Test Environment. | ||
| - | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:20_maintainability:testability#about | Testability]] | + | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.g_testing:start | Detailed discussion of types of Tests]] |
| - | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.g_testing:start | Appendix G: Tests]] | + | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:20_maintainability:testability#about | Testability]] Non-Functional Requirement |
| - | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:25_security | Securability ]] | + | * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:25_security | Securability ]] Non-Functional Requirement |
| - | Table {{ref>kindsOfTests}} lists the types of tests defined by the OMG DIDO-RA. All systems should have [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:p:p_p | Policies and Procedures]] in place to improve the quality of the system and increase reliability. Follow the links to get more detail on each test. | + | Table {{ref>kindsOfTests}} lists an overview of the types of tests defined by the OMG DIDO-RA. All systems should have [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:p:p_p | Policies and Procedures]] in place to improve the quality of the system and increase reliability. Follow the links to get more detail on each test. |
| <table kindsOfTests> | <table kindsOfTests> | ||
cbdc/public/cbdc_omg/04_doc/90_recommend/93_recomend/70_test.1652297451.txt.gz · Last modified: 2022/05/11 15:30 by nick
