Awesome GitHub RepositoriesDistributed Consensus Protocols

Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures. The system distinguishes itself through

ZooKeeper is a distributed coordination service that provides a centralized system for managing configuration, naming, and synchronization across a cluster of distributed processes. It functions as a cluster consensus service, a distributed configuration store, and a distributed lock manager to maintain a consistent state across multiple network nodes. The service implements a consensus protocol to ensure data consistency and uses a replicated state machine to maintain identical copies of the system state across all servers. It provides a distributed lock management system to coordinate exclu

This project is a curated collection of academic papers, books, and technical resources designed for studying the architecture and implementation of database management systems. It serves as a comprehensive educational guide for engineers and researchers looking to understand the fundamental principles behind modern data storage and retrieval. The repository distinguishes itself by providing structured learning paths across critical database domains, including the design of persistent storage engines, the mechanics of query optimization, and the complexities of distributed transaction managem

OceanBase is a distributed SQL database designed for high availability and strong consistency across multiple nodes and regions. It functions as a hybrid transactional and analytical processing engine, allowing real-time analytics and transactions to execute on a single data copy. The system also serves as a vector database engine for indexing and querying vector data to power semantic search and recommendation systems. The platform features native compatibility layers for MySQL and Oracle, enabling the migration of legacy workloads without rewriting SQL code. It utilizes a Paxos-based distri

ToyDB is a distributed SQL database that provides a system for storing and querying data across multiple nodes. It focuses on maintaining strong consistency and fault tolerance through the implementation of a distributed consensus algorithm. The project distinguishes itself by supporting historical data versioning, enabling time-travel queries to retrieve the state of the database from a specific point in the past. It utilizes multi-version concurrency control to manage ACID transactions and ensure data integrity during concurrent operations. The system covers relational data modeling with t

Tendermint is a Byzantine fault tolerant consensus engine that replicates a deterministic state machine across a cluster of machines while tolerating up to one-third malicious validators. It functions as a blockchain application platform, connecting application logic to the consensus engine through a socket-based protocol that enables development in any programming language. The system commits blocks when more than two-thirds of weighted validators sign and broadcast their votes, with proof included in the next block. It provides cryptographic state verification, allowing efficient authentica

Algodeck is an open-source collection of flash cards designed for reviewing algorithms, data structures, and system design concepts, specifically curated for technical interview preparation. The project organizes knowledge into atomic question-and-answer pairs and incorporates spaced repetition scheduling to optimize long-term memory retention. The flash card catalog covers a broad range of computer science topics, including classic sorting algorithms like quicksort and mergesort, data structure operations for arrays, trees, heaps, tries, and graphs, as well as bit manipulation techniques for

Blitzar is a verifiable SQL proof engine and cryptographic library designed for verifiable SQL computation. It enables the execution of database queries off-chain while generating zero-knowledge proofs that certify the correctness of the results for on-chain verification. The project distinguishes itself through a GPU-accelerated proof accelerator that offloads heavy cryptographic workloads to graphics processors, reducing the time required for succinct proof generation. It provides high-performance cryptographic primitives for C++ and Rust applications, focusing on elliptic curve operations

Zeebe هو محرك سير عمل سحابي أصلي وآلة حالة موزعة مصممة لتنسيق العمليات التجارية باستخدام معايير BPMN وDMN. يعمل كمحرك سير عمل gRPC عالي الأداء ينفذ عمليات تجارية معقدة من خلال بنية تدفق أحداث مجزأة. يعمل النظام أيضاً كمنسق لوكلاء النماذج اللغوية الكبيرة، حيث ينسق تفكير الذكاء الاصطناعي واستخدام الأدوات ضمن العمليات التجارية الحتمية. يتميز المحرك بشبكة وسيطة من نظير إلى نظير ونموذج تكرار بيانات قائم على الإجماع يضمن التوافر العالي وتحمل الأخطاء. يستخدم مجموعة وسطاء مجزأة لتحقيق قابلية التوسع الأفقي ويستخدم ضغطاً عكسياً للطلب التكيفي لتنظيم تدفق الأوامر الوارد ومنع التحميل الزائد للنظام. تغطي المنصة سطحاً واسعاً من الإمكانيات التشغيلية، بما في ذلك مراقبة التنفيذ في الوقت الفعلي مع خرائط حرارة الأداء، واتخاذ القرارات التجارية المؤتمتة عبر جداول القرار، وتنفيذ المهام الموزعة من خلال نموذج عامل مهمة يعتمد على الاقتراع. كما يوفر أدوات لعزل موارد المستأجرين المتعددين، والتحكم في الوصول القائم على الهوية، وتكامل واجهات برمجة تطبيقات الويب الخارجية والدوال بدون خادم. يمكن نشر النظام عبر بيئات مختلفة، بما في ذلك Kubernetes وDocker، ويتم إدارته من خلال مزيج من واجهة سطر الأوامر وواجهة برمجة تطبيقات REST برمجية.

braft is an embeddable C++ library that implements the Raft consensus algorithm, providing a distributed consensus engine for building fault-tolerant, replicated state machines. At its core, it manages leader election, log replication, cluster membership changes, and state machine synchronization across a cluster of nodes, ensuring strong consistency and data durability even in the face of node failures. The library distinguishes itself through a comprehensive set of mechanisms for reliable distributed coordination. It uses a randomized timeout-based leader election process with term manageme

Olric is a distributed data grid and in-memory key-value store that partitions and replicates data across a cluster of servers. It serves as a shared memory system for managing distributed maps, performing atomic operations, and acting as an in-memory data cache. The system provides a distributed locking mechanism for concurrency control and a pub-sub messaging system that broadcasts and routes messages over named channels across the cluster. The platform covers wide-ranging capabilities including cluster management and orchestration, data replication with configurable quorums, and automated

Stellar Core is the primary software implementation of the Stellar blockchain network, serving as a distributed ledger and a Federated Byzantine Agreement system. It functions as a core node that maintains the shared state of the network and provides a runtime environment for executing WebAssembly smart contracts. The project enables the creation and management of digital assets, including the implementation of decentralized exchanges through distributed orderbooks and automated liquidity pools. It facilitates cross-border payment settlement by routing assets via path payments and bridging di