Awesome GitHub RepositoriesDistributed Consensus Protocols

Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures. The system distinguishes itself through

ZooKeeper is a distributed coordination service that provides a centralized system for managing configuration, naming, and synchronization across a cluster of distributed processes. It functions as a cluster consensus service, a distributed configuration store, and a distributed lock manager to maintain a consistent state across multiple network nodes. The service implements a consensus protocol to ensure data consistency and uses a replicated state machine to maintain identical copies of the system state across all servers. It provides a distributed lock management system to coordinate exclu

This project is a curated collection of academic papers, books, and technical resources designed for studying the architecture and implementation of database management systems. It serves as a comprehensive educational guide for engineers and researchers looking to understand the fundamental principles behind modern data storage and retrieval. The repository distinguishes itself by providing structured learning paths across critical database domains, including the design of persistent storage engines, the mechanics of query optimization, and the complexities of distributed transaction managem

OceanBase is a distributed SQL database designed for high availability and strong consistency across multiple nodes and regions. It functions as a hybrid transactional and analytical processing engine, allowing real-time analytics and transactions to execute on a single data copy. The system also serves as a vector database engine for indexing and querying vector data to power semantic search and recommendation systems. The platform features native compatibility layers for MySQL and Oracle, enabling the migration of legacy workloads without rewriting SQL code. It utilizes a Paxos-based distri

ToyDB is a distributed SQL database that provides a system for storing and querying data across multiple nodes. It focuses on maintaining strong consistency and fault tolerance through the implementation of a distributed consensus algorithm. The project distinguishes itself by supporting historical data versioning, enabling time-travel queries to retrieve the state of the database from a specific point in the past. It utilizes multi-version concurrency control to manage ACID transactions and ensure data integrity during concurrent operations. The system covers relational data modeling with t

Tendermint is a Byzantine fault tolerant consensus engine that replicates a deterministic state machine across a cluster of machines while tolerating up to one-third malicious validators. It functions as a blockchain application platform, connecting application logic to the consensus engine through a socket-based protocol that enables development in any programming language. The system commits blocks when more than two-thirds of weighted validators sign and broadcast their votes, with proof included in the next block. It provides cryptographic state verification, allowing efficient authentica

Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for

Blitzar 是一个可验证的 SQL 证明引擎和加密库，专为可验证的 SQL 计算而设计。它支持在链下执行数据库查询，同时生成零知识证明，以证明结果的正确性，从而实现链上验证。 该项目以其 GPU 加速的证明加速器脱颖而出，该加速器将繁重的加密工作负载卸载到图形处理器，减少了简洁证明生成所需的时间。它为 C++ 和 Rust 应用提供了高性能加密原语，专注于椭圆曲线运算和多标量乘法。 该系统涵盖了广泛的数据管理和安全面，包括将区块链索引与链下数据集结合到防篡改关系表中的无信任数据集成。它利用 BFT 共识和阈值签名来维护状态完整性，以及用于基于法定人数的数据同步和通过智能合约回调进行验证结果交付的机制。 该代码库提供了 C++ 和 Rust 的原生绑定，以公开其加密工具集和证明计算库。

Zeebe 是一个云原生工作流引擎和分布式状态机，旨在通过 BPMN 和 DMN 标准进行业务流程编排。它作为一个高性能 gRPC 工作流运行时，通过分区事件流架构执行复杂的业务流程。该系统还作为大语言模型代理的编排器，在确定性业务流程中协调 AI 推理和工具使用。 该引擎通过其点对点代理网络和确保高可用性和容错性的基于共识的数据复制模型而脱颖而出。它采用分区代理集群来实现水平扩展，并利用自适应请求背压来调节传入的命令流并防止系统过载。 该平台涵盖了广泛的操作功能，包括带有性能热力图的实时执行监控、通过决策表的自动化业务决策，以及通过基于轮询的作业工作者模型进行的分布式任务执行。它还提供用于多租户资源隔离、基于身份的访问控制以及集成外部 Web API 和无服务器函数的工具。 该系统可部署在 Kubernetes 和 Docker 等各种环境中，并通过命令行界面和程序化 REST API 的组合进行管理。

braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus engine for building fault-tolerant, replicated state machines. At its core, it manages leader election, log replication, cluster membership changes, and state machine synchronization across a cluster of nodes, ensuring strong consistency and data durability even in the face of node failures. The library distinguishes itself through a comprehensive set of mechanisms for reliable distributed coordination. It uses a randomized timeout-based leader election process with term manageme

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

Stellar Core is the primary software implementation of the Stellar blockchain network, serving as a distributed ledger and a Federated Byzantine Agreement system. It functions as a core node that maintains the shared state of the network and provides a runtime environment for executing WebAssembly smart contracts. The project enables the creation and management of digital assets, including the implementation of decentralized exchanges through distributed orderbooks and automated liquidity pools. It facilitates cross-border payment settlement by routing assets via path payments and bridging di