dicedb/dicedb
Dicedb
DiceDB is a distributed cache manager and hierarchical storage engine based on a Valkey key-value store. It functions as a high-availability key-value cluster that balances performance and cost by distributing data across memory and disk tiers.
The system supports working sets larger than available RAM by persisting evicted keys to disk and restoring them on demand. It also includes a real-time query subscription system that notifies clients when data matching specific criteria is updated.
The project provides distributed cache coordination through master node health monitoring and quorum-based failover. Additional capabilities include gossip-based network discovery, a module extension system for loading shared objects, and tools for managing process logging and network interface binding.
Features
- Key-Value Stores - Built as a high-performance key-value store based on Valkey to provide core data structures and communication.
- Disk Persistence - Persists evicted keys to disk and restores them on cache misses to maintain large working sets.
- Distributed Caches - Acts as a distributed cache manager that persists evicted keys to disk to support oversized working sets.
- Hierarchical Engines - Functions as a hierarchical storage engine that distributes data across memory and disk tiers.
- Key-Value - Implements a low-latency storage engine for key-value pairs enabling fast retrieval and persistence.
- Storage Tiering - Automatically moves data between memory and disk tiers based on access patterns to balance performance and cost.
- High Availability Systems - Implements a distributed key-value cluster with master node monitoring and quorum-based failover for high availability.
- Quorum-Based Elections - Ensures high availability through quorum-based leader election and failover monitoring.
- Distributed Coordination Systems - Manages node health and failover processes in a cluster to ensure continuous data availability.
- Master Node Health Monitors - Implements a health tracking system for master nodes that triggers failover based on quorum agreement.
- Data Change Subscriptions - Provides a real-time subscription system that notifies clients when data matching specific queries is updated.
- Real-time Data Subscriptions - Notifies clients instantly when data matching specific queries changes to enable reactive workflows.
- Database Systems - Listed in the “Database Systems” section of the Awesome Go awesome list.
