The Data Lifecycle covers the stages a particular piece of data transitions through from its initial generation or capture to its eventual archival and/or deletion at the end of its useful life. Data Management (DM) is the coordination and administration of all data associated with a project, program or effort. Data Management includes the metadata as well as the individual pieces of data as it progresses through the Data Lifecycle. Data management follows a Data Strategy, which includes the required business rules, especially those captured in any governing Legal Documents such as the Charter, By-Laws, and policy and Procedures. Figure 1 reflects the major stages in the Data Lifecycle:
HTTP(S), File Transfer Protocol (FTP), SMTP, Short Message Service (SMS), InterPlanetary File System (IPFS), Data Distribution Service (DDS), ]]dido:public:ra:xapend:xapend.a_glossary:b:blockchain]], Distributed Ledger Technology (DLT), etc.
Wigmore1) defines only six stages for the Data Lifecycle:
The main differences betwen a generic Data Lifecycle and a DIDO Data Lifecycle is that in the idealized DIDO Data Lifecycle the Destroy and Archive stages are non-existent or modified. See Figure 2.
However, because the data within a DIDO is theoretically immutable and no data is ever lost, the panacea of “unlimited” data storage is being challenged. There are different ways that the size of the ledgers can be managed. One way is to have different kinds of nodes with each node containing differing amounts of data. See section 2.3.3 Node Taxonomy.
Another mechanism to overcome the “size” issue is to use Sharding. Sharding splits a database (in a DIDO the Ledger) horizontally into Shards spreading the load across the many Shards. In an Ethereum context, Sharding is intended to reduce network congestion and increase transactions per second by creating new Shards referred to as Chains.
Iota is using a form of Sharding called Streams and has an Request For Proposal (RFP) at the Object Management Group® (OMG®) to provide a standardized specification for publishing, subscribing and validating the transactions on the “Tangle” (Iota's version of Directed Acyclic Graph (DAG)). 2), 3)
[char][✓ char, 2022-03-20]New Section -- review