Awesome GitHub RepositoriesCross-Zone Data Distribution

TiKV is a cloud-native distributed transactional key-value store and storage engine. It provides a distributed database designed for horizontal scalability and strong consistency across a cluster of physical nodes. The system uses a Raft-based consensus mechanism to maintain data availability and state synchronization. It ensures ACID compliance for distributed transactions through a two-phase commit workflow and manages data distribution via multi-Raft sharding. The engine handles massive datasets using automated range splitting and cluster load balancing to distribute data across different

AutoMQ is a cloud-native streaming platform and Apache Kafka distribution that implements a decoupled compute and storage architecture. It functions as an S3-backed message queue, using object storage as the primary log repository to eliminate dependencies on local disks. The platform utilizes a stateless broker architecture to enable dynamic compute scaling and automated partition balancing. This design allows the system to adjust the number of brokers in seconds and distribute network traffic without requiring manual data migration or partition reassignment. The system provides multi-avail

OceanBase is a distributed SQL database designed for high availability and strong consistency across multiple nodes and regions. It functions as a hybrid transactional and analytical processing engine, allowing real-time analytics and transactions to execute on a single data copy. The system also serves as a vector database engine for indexing and querying vector data to power semantic search and recommendation systems. The platform features native compatibility layers for MySQL and Oracle, enabling the migration of legacy workloads without rewriting SQL code. It utilizes a Paxos-based distri

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Cortex is an open-source, horizontally scalable metrics platform that ingests, stores, and queries Prometheus-compatible time-series data with multi-tenant isolation. It accepts metrics via Prometheus remote write and OpenTelemetry, executes PromQL queries against both recent and historical data, and provides a Prometheus-compatible alerting and recording rule engine with an integrated Alertmanager. The system is built as a set of independently scalable microservices that use hash-ring-based sharding, gossip-based cluster membership, and tenant-aware object storage to distribute workloads acro

YDB هي قاعدة بيانات SQL موزعة ومحرك تحليلي مصمم لقابلية التوسع الأفقي والاتساق القوي. تعمل كنظام متعدد النماذج يدعم أحمال العمل المعاملاتية والتحليلية من خلال معمارية موزعة توفر معاملات ACID قابلة للتسلسل. يتميز النظام بتوافقه الواسع مع البروتوكولات، حيث ينفذ بروتوكول PostgreSQL لبرامج تشغيل SQL القياسية وبروتوكول Kafka للمراسلة والبث. كما يعمل كقاعدة بيانات متجهة، حيث يدعم فهارس المتجهات وعمليات البحث عن أقرب جار تقريبي للبحث الدلالي والتضمينات. تدير المنصة البيانات باستخدام نموذج تخزين هجين مع تنسيقات موجهة للصفوف وموجهة للأعمدة، باستخدام تنفيذ الاستعلام المتجه لتحليلات على نطاق البيتابايت. يشمل سطحها التشغيلي بث تغيير البيانات (CDC)، وطوابير ثابتة مرة واحدة بالضبط، وتوافر عالي متعدد المناطق. يتم دعم النشر وإدارة دورة الحياة من خلال مشغل Kubernetes وتوفير البنية التحتية ككود.