Awesome GitHub RepositoriesDistributed Consensus Protocols

Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures. The system distinguishes itself through

ZooKeeper is a distributed coordination service that provides a centralized system for managing configuration, naming, and synchronization across a cluster of distributed processes. It functions as a cluster consensus service, a distributed configuration store, and a distributed lock manager to maintain a consistent state across multiple network nodes. The service implements a consensus protocol to ensure data consistency and uses a replicated state machine to maintain identical copies of the system state across all servers. It provides a distributed lock management system to coordinate exclu

This project is a curated collection of academic papers, books, and technical resources designed for studying the architecture and implementation of database management systems. It serves as a comprehensive educational guide for engineers and researchers looking to understand the fundamental principles behind modern data storage and retrieval. The repository distinguishes itself by providing structured learning paths across critical database domains, including the design of persistent storage engines, the mechanics of query optimization, and the complexities of distributed transaction managem

OceanBase is a distributed SQL database designed for high availability and strong consistency across multiple nodes and regions. It functions as a hybrid transactional and analytical processing engine, allowing real-time analytics and transactions to execute on a single data copy. The system also serves as a vector database engine for indexing and querying vector data to power semantic search and recommendation systems. The platform features native compatibility layers for MySQL and Oracle, enabling the migration of legacy workloads without rewriting SQL code. It utilizes a Paxos-based distri

ToyDB is a distributed SQL database that provides a system for storing and querying data across multiple nodes. It focuses on maintaining strong consistency and fault tolerance through the implementation of a distributed consensus algorithm. The project distinguishes itself by supporting historical data versioning, enabling time-travel queries to retrieve the state of the database from a specific point in the past. It utilizes multi-version concurrency control to manage ACID transactions and ensure data integrity during concurrent operations. The system covers relational data modeling with t

Tendermint is a Byzantine fault tolerant consensus engine that replicates a deterministic state machine across a cluster of machines while tolerating up to one-third malicious validators. It functions as a blockchain application platform, connecting application logic to the consensus engine through a socket-based protocol that enables development in any programming language. The system commits blocks when more than two-thirds of weighted validators sign and broadcast their votes, with proof included in the next block. It provides cryptographic state verification, allowing efficient authentica

Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for

Blitzar is a verifiable SQL proof engine and cryptographic library designed for verifiable SQL computation. It enables the execution of database queries off-chain while generating zero-knowledge proofs that certify the correctness of the results for on-chain verification. The project distinguishes itself through a GPU-accelerated proof accelerator that offloads heavy cryptographic workloads to graphics processors, reducing the time required for succinct proof generation. It provides high-performance cryptographic primitives for C++ and Rust applications, focusing on elliptic curve operations

Zeebe este un motor de workflow cloud-native și o mașină de stare distribuită concepută pentru orchestrarea proceselor de business folosind standardele BPMN și DMN. Operează ca un runtime de workflow gRPC de înaltă performanță care execută procese de business complexe printr-o arhitectură de event-streaming partiționată. Sistemul funcționează, de asemenea, ca un orchestrator pentru agenți de tip LLM, coordonând raționamentul AI și utilizarea instrumentelor în cadrul proceselor de business deterministe. Motorul se distinge prin rețeaua de brokeri peer-to-peer și un model de replicare a datelor bazat pe consens care asigură disponibilitate ridicată și toleranță la erori. Utilizează un cluster de brokeri partiționat pentru a obține scalabilitate orizontală și utilizează backpressure adaptiv pentru a regla fluxul de comenzi primite și a preveni supraîncărcarea sistemului. Platforma acoperă o suprafață largă de capabilități operaționale, inclusiv monitorizarea execuției în timp real cu hărți termice de performanță, luarea deciziilor de business automate prin tabele de decizie și execuția distribuită a sarcinilor printr-un model de job worker bazat pe polling. Oferă, de asemenea, instrumente pentru izolarea resurselor multi-tenant, controlul accesului bazat pe identitate și integrarea API-urilor web externe și a funcțiilor serverless. Sistemul poate fi implementat în diverse medii, inclusiv Kubernetes și Docker, și este gestionat printr-o combinație de interfață în linie de comandă și API REST programatic.

braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus engine for building fault-tolerant, replicated state machines. At its core, it manages leader election, log replication, cluster membership changes, and state machine synchronization across a cluster of nodes, ensuring strong consistency and data durability even in the face of node failures. The library distinguishes itself through a comprehensive set of mechanisms for reliable distributed coordination. It uses a randomized timeout-based leader election process with term manageme

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

Stellar Core is the primary software implementation of the Stellar blockchain network, serving as a distributed ledger and a Federated Byzantine Agreement system. It functions as a core node that maintains the shared state of the network and provides a runtime environment for executing WebAssembly smart contracts. The project enables the creation and management of digital assets, including the implementation of decentralized exchanges through distributed orderbooks and automated liquidity pools. It facilitates cross-border payment settlement by routing assets via path payments and bridging di