D.A.G.G.E.R. Roadmap Overview

Welcome

Welcome to the Roadmap for GenesysGo's new Directed Acyclic Gossip Graph Enabling Replication Protocol (D.A.G.G.E.R.). This Roadmap offers a high-level overview of our forthcoming development plans for D.A.G.G.E.R. It's important to note that features and timelines may evolve as we gain new insights and knowledge. For a more in-depth exploration of the technical intricacies of D.A.G.G.E.R., we encourage you to read the Litepaper. If you want to participate and run a D.A.G.G.E.R. Wield Node, please visit our Wield Node Docs page for instructions.

Testnet Phase 1 (Q3-Q4 2023)

Completed

1. Released initial interactive explorer version with the base set of features
2. Found and resolved numerous performance bottlenecks with D.A.G.G.E.R. core and D.A.G.G.E.R. Client RPC
3. Improved memory utilization and efficiency with file uploads and gossip network message processing
4. Improved multithreading in D.A.G.G.E.R. Client RPC, allowing for much more throughput than initially observed for clients not sending transactions directly to D.A.G.G.E.R. wield nodes.
5. Observed a crash event that caused nodes to fall behind and become unable to catch up under specific throughput conditions. Collected metrics & logs and was able to resolve the node crashing scenario
6. Improved memory management by moving finalized graph history to disk
7. Collected metrics on >250 million transactions and events (excluding peer-to-peer sync events/voting), allowing for insights into detailed system tuning and improvements for Linux hosts
8. Observed various network loads up to 4gbps while sustaining 20k transactions per second + file uploads
9. Improved the D.A.G.G.E.R. node CLI & documentation for node operation
10. Developed graph history snapshot system‍ 
11. Launched the reference ShdwDrive File Management UI on portal.shdwdrive.com

‍In Progress‍

12. Complete testing the finalized implementation of dynamic node membership
13. Complete D.A.G.G.E.R. keypair management CLI
14. Client RPC documentation 

Upcoming

15. Remote node metrics collection system 
16. Typescript keypair SDK
17. Improved event & state distribution system over p2p network
18. Additional interactive features for the reference ShdwDrive File Management UI
    ‍

Testnet Phase 2 (Q1-Q2 2024)

Upcoming

1. Distribute individual node operator documentation and begin Testnet Phase 2 with decentralized operators
2. Study and improve individual node operator stability
3. Improve metrics and logs on network performance and stability of operators
4. Build out block and graph explorer features
5. Improve RPC documentation
6. Add additional RPC methods
7. Complete epoch testing
8. Complete snapshot testing
9. Run adversarial scenario simulations
10. Address bugs or vulns found during individual node operator testing
11. ShdwDrive v2 implementation - repair bandwidth management
12. Fanout data distribution system & other improvements to comms layer/file system operations 
13. ShdwDrive v2 implementation - core feature development and improvements
    ‍

Testnet Phase 3 (Q2-Q3 2024)

Upcoming

1. Individual node operators for ShdwDrive v2
2. Observe usage / logs / etc and make further system tweaks as necessary
3. Resolve any outstanding bugs or accrued technical debt
4. Publish an updated version of the Roadmap with subsequent phases and features