Awesome GitHub RepositoriesDatabase Sharding Solutions

Dragonfly is a high-performance, multi-model in-memory data store designed to serve as a drop-in replacement for existing database infrastructures. By utilizing a multi-threaded, shared-nothing architecture and a fiber-based concurrency model, it maximizes CPU utilization and minimizes latency for read and write operations. The system supports a wide range of data structures, including strings, hashes, lists, sets, sorted sets, and JSON documents, while maintaining full compatibility with standard industry wire protocols and client libraries. What distinguishes Dragonfly is its focus on effic

Vitess is a database clustering system for horizontal scaling of MySQL. It functions as a middleware layer that abstracts complex sharding and physical topology, allowing applications to interact with a distributed database environment through a unified interface. By intercepting and routing SQL queries across multiple shards, it enables large-scale data management while maintaining the appearance of a single database instance. The platform distinguishes itself through its ability to perform online schema migrations and distributed transaction coordination without requiring application downti

该项目是一个数据库扩展，支持跨多个 PostgreSQL 节点的水平扩展和分布式数据分区。它作为一个中间件解决方案，将大型数据库表分布在集群中，以增加总存储容量并提高不断增长的数据集的写入性能。 该系统采用基于哈希的分区将表记录分布在物理节点上，并使用中央元数据目录来跟踪分片位置。它提供透明的查询路由，将标准 SQL 命令从协调节点引导至适当的工作节点，而无需修改现有的应用逻辑。 该框架包含通过分片复制和自动一致性修复过程来维护数据冗余和集群完整性的工具。它还支持高吞吐量数据摄入，利用并发处理将海量数据集导入分布式表中。