18 रिपॉजिटरी
Replication architectures where multiple nodes can serve both read and write requests.
Distinguishing note: Focuses on the coordination between multiple masters, distinct from primary-replica setups.
Explore 18 awesome GitHub repositories matching data & databases · Multi-Master Replication. Refine with filters or upvote what's useful.
This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-
Details the operational benefits and coordination of master-master replication.
Zheng is a Spring Boot microservices framework and enterprise J2EE development platform. It functions as a distributed service gateway and identity provider, providing a foundation for building complex business applications and microservices infrastructure. The project includes a comprehensive enterprise content management system and an OAuth2 identity provider for managing single sign-on and third-party social login integrations. It also features a MyBatis ORM code generator that automatically creates database models and boilerplate functions from existing tables. The platform covers a broa
Routes data traffic between primary and replica database instances based on read or write operations.
KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu
Implements a synchronization system where multiple instances simultaneously accept reads and writes.
Predis is a PHP library for connecting to and executing commands against Redis and Valkey data stores. It functions as a client for managing data integration, providing dedicated implementations for cluster sharding, pub/sub messaging, and Sentinel-based service discovery. The project distinguishes itself through specialized clients for executing server-side Lua scripts with automated hash caching and a cluster client that supports gossip protocols and key distribution. It also implements a Sentinel client to manage high availability and failover within replicated environments. The library c
Directs write operations to the master node while balancing read-only queries across multiple replica nodes.
CouchDB एक NoSQL दस्तावेज़ डेटाबेस है जो डेटा को लचीले दस्तावेज़ों के रूप में संग्रहीत करता है और HTTP पर डेटा प्रबंधन के लिए एक RESTful API को उजागर करता है। यह एक वितरित दस्तावेज़ स्टोर के रूप में कार्य करता है, जो उच्च उपलब्धता और स्थिरता सुनिश्चित करने के लिए कई नोड्स में डेटा को सिंक्रनाइज़ और रेप्लिकेट करता है। सिस्टम में एक फुल-टेक्स्ट सर्च इंजन शामिल है जो डेटाबेस रिकॉर्ड को क्वेरी करने योग्य दस्तावेज़ों में बदल देता है, जो सॉर्टिंग और पेजिनेशन का समर्थन करता है। डेटा सिंक्रोनाइज़ेशन मल्टी-मास्टर रेप्लिकेशन के माध्यम से संभाला जाता है, जो वितरित नोड्स में स्थिरता बनाए रखने के लिए संशोधन इतिहास का आदान-प्रदान करता है। डेटाबेस मल्टी-वर्जन कॉनकरेंसी कंट्रोल का उपयोग करता है ताकि लॉक के बिना एक साथ पढ़ने और लिखने की अनुमति मिल सके। स्टोरेज को क्रैश रिकवरी और कुशल डिस्क-आधारित लुकअप की सुविधा के लिए केवल-अपेंड और B-ट्री आधारित संरचनाओं के माध्यम से प्रबंधित किया जाता है।
Implements a replication architecture where multiple nodes can concurrently serve both read and write requests.
xorm is a relational mapper and object-relational mapping tool for Go. It translates Go structures into SQL queries and maps database rows back into native objects, providing a multi-dialect database driver that supports MySQL, PostgreSQL, SQLite, Oracle, SQL Server, and TiDB. The project features a read-write splitting manager that routes modification requests to a primary database and read requests to replicas. It includes a database schema synchronizer to automatically align table structures and indexes with application data models, as well as a fluent SQL query builder for constructing co
Routes modification requests to a primary database and read requests to replicas.
GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
Assigns datanodes to dedicated read or write groups to prevent query degradation.
This project is a dynamic datasource manager for Spring Boot designed to handle multiple database connections and switch between them at runtime. It provides a system for managing database read-write splitting, coordinating distributed transactions across disparate databases, and updating connection settings without requiring an application restart. The framework differentiates itself through its ability to route traffic based on user sessions or headers to support multi-tenant architectures. It also includes a mechanism for encrypting sensitive database credentials within configuration files
Routes traffic between master and slave databases to optimize performance and load balancing.
Sequel is a relational database toolkit for Ruby that provides object-relational mapping, a fluent SQL query builder, and schema migration capabilities. It maps database tables to Ruby classes with support for associations, validations, lifecycle hooks, and eager loading, offering a comprehensive ORM layer for building data-centric applications. Sequel distinguishes itself through a plugin-based extension architecture that allows composable customization of models, databases, and datasets without relying on deep inheritance hierarchies. It includes a thread-safe connection pool with support f
Defines multiple named server configurations for primary, replicas, and shards through a database option.
Pigsty is a full-stack orchestration suite for deploying, monitoring, and managing high-availability PostgreSQL clusters and their supporting infrastructure. It functions as a cluster management platform and high-availability suite that automates failover, manages virtual IPs, and ensures data consistency through distributed consensus. The project distinguishes itself by providing a comprehensive database infrastructure-as-code framework and a dedicated observability stack. It incorporates a backup and recovery manager supporting point-in-time recovery via S3-compatible object storage, alongs
Supports multi-master regional distribution of PostgreSQL instances to enable local writes and logical replication.
FreeSql is a .NET object-relational mapper and data access layer that translates object-oriented code into SQL for multiple relational database providers. It functions as a fluent SQL query builder and database schema synchronizer, allowing developers to align database table and index structures with entity class definitions. The framework is specifically optimized for .NET Native AOT to ensure reduced memory footprints and faster startup times. It includes a database traffic manager to distribute load through read-write splitting, dynamic table sharding, and tenant-based data isolation. Bro
Routes read operations to replicas and write operations to a primary master database.
This project is a containerized deployment of an OpenLDAP server, providing a lightweight directory access protocol service for storing and retrieving organizational data and user credentials. It functions as a directory server for identity management and user authentication across network services. The service supports the creation of LDAP replication clusters to maintain data consistency across multiple hosts for high availability. It includes capabilities for secure connectivity through TLS encryption and certificate management to protect sensitive directory data during transmission. Addi
Implements a replication architecture where multiple nodes can serve both read and write requests.
SLIME is a distributed reinforcement learning framework for large language model post-training that bridges Megatron training with SGLang inference servers. It orchestrates scalable RL loops across GPU clusters, decoupling training and inference into independent processes that communicate over HTTP and NCCL for independent scaling and fault tolerance. The system supports multi-agent reinforcement learning workflows with parallel agent instances, customizable rollout strategies, and personalized agent serving that improves models from prior conversations without disrupting API serving. The fra
Defines independent prefill and decode server groups with per-group GPU counts, tensor-parallel sizes, and SGLang overrides for production topologies.
Orioledb PostgreSQL के लिए एक क्लाउड-नेटिव स्टोरेज इंजन है जिसे आधुनिक हार्डवेयर पर वर्टिकल स्केलेबिलिटी और प्रदर्शन में सुधार करने के लिए डिफ़ॉल्ट स्टोरेज लेयर को बदलने के लिए डिज़ाइन किया गया है। यह एक इंडेक्स-ऑर्गनाइज्ड टेबल स्टोर के रूप में कार्य करता है, जो डेटा रिट्रीवल को तेज करने के लिए टेबल पंक्तियों को सीधे प्राथमिक इंडेक्स के भीतर व्यवस्थित करता है। इंजन डेटा वर्शनिंग को प्रबंधित करने के लिए एक अनडू लॉग स्टोरेज सिस्टम का उपयोग करता है, जो मैन्युअल वैक्यूमिंग की आवश्यकता को समाप्त करता है और टेबल ब्लोट को रोकता है। यह ब्लॉक-लेवल और पेज-लेवल डेटा कम्प्रेशन के माध्यम से डिस्क फुटप्रिंट को और कम करता है। यह प्रोजेक्ट उन्नत इंडेक्स प्रबंधन और स्वचालित डेटाबेस रखरखाव के लिए क्षमताएं प्रदान करता है। इसमें रो-लेवल लॉगिंग के माध्यम से उच्च उपलब्धता रिकवरी के लिए सुविधाएं शामिल हैं, साथ ही स्थान उपयोग का विश्लेषण करने और टेबल अखंडता को सत्यापित करने के लिए उपकरण भी शामिल हैं।
Supports active-active clusters using consensus algorithms and row-level logs for multi-master replication.
Riak is a decentralized NoSQL key-value store designed for high availability and fault tolerance. It is a Dynamo-style distributed database that utilizes consistent hashing and eventual consistency to scale data across a cluster of nodes. The system functions as a geo-replicated datastore, synchronizing data across multiple physical locations to provide disaster recovery and maintain availability during regional outages. It employs a multi-master replication model, allowing writes to any node in the cluster. The platform covers broad capability areas including decentralized cluster coordinat
Supports a multi-master replication model allowing write operations to any node in the cluster.
cr-sqlite is a multi-master database replication system that uses conflict-free replicated data types to ensure eventual consistency across distributed nodes. It provides the core capabilities for offline-first data synchronization, allowing multiple database instances to merge concurrent updates and reach a consistent state. The project distinguishes itself through a combination of CRDT-based data replication and a WASM-based database engine, enabling full SQL execution and state persistence within web browsers. It supports peer-to-peer replication and cross-tab synchronization, utilizing ca
Implements a multi-master replication system using SQLite and CRDTs to ensure eventual consistency across distributed nodes.
FalkorDB is a high-performance graph database management system and vector graph database. It serves as a knowledge graph construction tool and a GraphRAG knowledge store, integrating structured property graphs with vector search to provide grounded context for large language models. The engine is designed as a multi-tenant graph engine, capable of hosting thousands of isolated datasets within a single instance. The system distinguishes itself by using linear algebra for query execution, treating relationship tensors as matrix multiplications to achieve low-latency multi-hop traversals. It ut
Separates read replicas from the primary write server to scale different workload types independently.
pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency
Implements routing strategies that separate read and write operations, directing writes to the primary and reads to replicas.