Differences

This shows you the differences between two versions of the page.

--- cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:70_test [2022/05/11 14:24]
nick
+++ cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:70_test [2022/06/17 19:46] (current)
terrance
@@ Line 1: / Line 1: @@
-====== 6.11.5 Simulation, Training and Testing Environment ======
+====== 6.11.7 Simulation, Training and Testing Environment ======
-[[cbdc:private:cbdc_omg:04_doc:90_recommend:93_recomend:start | Return to RDT&E]]
+|< 100% >|
+| [[cbdc:public:cbdc_omg:04_doc:90_recommend:93_recomend:start| Return to RDT&E]]   |  <WRAP>
+<html><b>
+<a href="mailto:[email protected]?Subject=OMG's CBDC WG Response:
+.11.7 Simulation, Training and Testing Environment
+">Provide Feedback</a></b>
+</html>
+</WRAP>  |
-The OMG members recommend the Federal Reserve invest [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:rtd_e | Research Development Test & Evaluation (RDT&E) Funding ]] in developing and perfecting a Simulation, Training, and Test environment.
+The OMG's CBDC WG members recommend the Federal Reserve invest [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:rtd_e | Research Development Test & Evaluation (RDT&E) Funding ]] in developing and perfecting a Simulation, Training, and Test environment.
-This environment should allow for the creation and running of thousands of Distributed Nodes of different types to simulate a real distributed environment in a matter of seconds or at most minutes. The testing environment needs to be able to start from a known starting point each time it is run, especially to support [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:regressiontesting  | Regression Testing]].
+This environment should allow for the creation and running of thousands of Distributed Nodes of different types to simulate a real distributed environment in a matter of seconds or at most minutes. The Testing Environment (TE) needs to be able to start from a known starting point each time it is run, especially to support [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:r:regressiontesting  | Regression Testing]].
-This kind of testing environment is different than the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:s:sandbox | Sandboxes]] most Cryptocurrencies currently offer. These cryptocurrency sandboxes work on actual distributed systems with a set of collective nodes running on actual networks. This means the rigor of the testing is compromised since the state of the sandbox is a moving target (i.e., it is not the same this time it is run as it was the last time it was run). Additionally, Sandbox testing means the ability to release hostile agents into the environment is extremely limited (who wants to have a hostile agent accidentally release a malicious agent into the wild?). It also limits the testing of the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:n:netdev | Network Devices]] (i.e., hub, switch, etc.) and the use of [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:h:http_sniffer | HTTP Sniffers]].
+This kind of Testing Environment (TE) is different than the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:s:sandbox | Sandboxes]] most Cryptocurrencies currently offer. These cryptocurrency sandboxes work on actual distributed systems with a set of collective nodes running on actual networks. This means the rigor of the testing is compromised since the state of the sandbox is a moving target (i.e., it is not the same this time it is run as it was the last time it was run). Additionally, Sandbox testing means the ability to release hostile agents into the environment is extremely limited (who wants to have a hostile agent accidentally release a malicious agent into the wild?). It also limits the testing of the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:n:netdev | Network Devices]] (i.e., hub, switch, etc.) and the use of [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:h:http_sniffer | HTTP Sniffers]].
-Using a Testing Environment from the onset of the CBDC, helps fulfill the Non-Functional Requirement for Testability.
+A Testing Environment (TE) can support simulation by allowing the morphology (number and kinds of nodes) of the Environment to be altered and rerun. Although the performance metrics collected during each run would not necessarily reflect the actual metrics during a real deployment, they would be useful relative to each other allowing for an informed decision-making process.
-  : **Note:** [[dido:public:ra:xapend:xapend.a_glossary:t:testability | Testability]], Testable, Testing, and Test are not synonyms for each other. Just because a system or program is undergoing testing using various tests does not necessarily mean that the system or program is actually Testable.
+Training Environment leverages the TE by using the Testing Environment as a platform for training people and AI on different well-known scenarios. The TE would be started at a known point each time and the people or the intelligent agents could learn through the use of "what happens if" scenarios. The metrics collected could be used to assess the results.
+Using a Testing Environment (TE) from the onset of the CBDC helps fulfill the Non-Functional Requirement for Testability.
-  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:20_maintainability:testability#about | Testabiloity]]
+  : **Note:** [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:t:testability | Testability]], Testable, Testing, and Test are not synonyms for each other. Just because a system or program is undergoing testing using various tests does not necessarily mean that the system or program is actually Testable. See section [[cbdc:public:cbdc_omg:04_doc:90_recommend:50_recomend:start]].
-  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.g_testing:start | Appendix G: Tests]]
-  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:25_security | Securabioity ]]
-Table {{ref>kindsOfTests}} lists the types of tests defined by the OMG DIDO-RA. All systems should have policies and procedures in place to improve the quality of the system and increase reliability. Follow the links to get more detail on each test.
+The following sections from the [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra | OMG DIDO Reference Architecture (DIDO-RA)]] could be helpful in understanding the creation of a Test Environment.
+  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.g_testing:start | Detailed discussion of types of Tests]]
+  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:20_maintainability:testability#about | Testability]] Non-Functional Requirement
+  * [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:1.4_req:2_nonfunc:25_security | Securability ]] Non-Functional Requirement
+Table {{ref>kindsOfTests}} lists an overview of the types of tests defined by the OMG DIDO-RA. All systems should have [[https://www.omgwiki.org/dido/doku.php?id=dido:public:ra:xapend:xapend.a_glossary:p:p_p | Policies and Procedures]] in place to improve the quality of the system and increase reliability. Follow the links to get more detail on each test.
 <table kindsOfTests>

OMG Central Bank Digital Currency (OMG-CBDC) Working Group (WG) Wiki

User Tools

Site Tools

Differences

Page Tools