Awesome GitHub RepositoriesConsensus Replication Protocols

TiDB is a horizontally scalable, distributed SQL database designed to provide consistent transactional storage and high-performance analytical processing within a single unified architecture. It utilizes a decoupled compute-storage design and a distributed key-value storage layer to ensure horizontal scalability and efficient range-based queries. By employing a consensus-based replication algorithm, the system maintains high availability and automatic failover across multiple nodes and geographical regions. The platform distinguishes itself through its hybrid transactional and analytical proc

Turso is a distributed SQL database platform that provides managed, edge-hosted SQLite instances. It functions as a serverless database provider, enabling the deployment of relational databases that synchronize data across multiple geographic regions to support high availability and performance. The platform distinguishes itself by utilizing a fork of SQLite as its core storage engine, which supports both local file storage and remote network-based replication. It employs an edge-optimized proxy to route queries through a global network, minimizing latency by connecting users to the nearest d

Aeron provides infrastructure components for high-speed inter-process and network communication, archiving message streams, and coordinating replicated services. It functions as a system for moving data between remote applications or local processes with low latency and high throughput. The project distinguishes itself through a combination of shared memory for ultra-low latency inter-process communication and a reliable UDP messaging transport that supports both unicast and multicast. It further includes a consensus-based service orchestrator to maintain consistency across replicated state m

Iggy 是一个分布式消息流平台和多协议消息代理，作为持久化分布式日志存储运行。它为使用追加日志（append-only log）发布和消费二进制消息提供了基础设施，通过 Viewstamped Replication 确保跨节点的高可用性和数据一致性。 该平台以其专业的 LLM 流式基础设施而著称，该基础设施使用服务器协议将大语言模型连接到流数据和系统控制。这包括通过 HTTP 或标准输入输出进行上下文管理和数据桥接的标准化协议。 该系统涵盖了广泛的功能，包括带有模块化源和汇插件的数据管道编排、用于水平扩展的消费者组协调，以及跨 TCP、QUIC、HTTP 和 WebSocket 的多协议传输支持。它还集成了诸如用于静态和传输中数据的 AES-256-GCM 加密等安全原语，并通过 Prometheus 指标、OpenTelemetry 追踪和操作 Web 仪表板提供可观测性。 该服务器可以使用容器镜像部署，并通过 Kubernetes 进行编排。