Awesome GitHub RepositoriesDatabase High Availability

FoundationDB is an ACID-compliant distributed transactional key-value store. It functions as a scalable database engine that ensures strict serializability and data consistency across a cluster of servers using a shared-nothing architecture. The system is distinguished by its multi-region replication capabilities, allowing data to be synchronized across different datacenters for high availability and disaster recovery. It utilizes optimistic concurrency control to manage distributed transactions and employs a majority-based coordination system to maintain cluster state. The platform provides

CacheCloud is a cloud management platform and infrastructure orchestrator for Redis. It provides a centralized dashboard to deploy, scale, and monitor Redis instances across standalone, sentinel, and cluster architectures. The system standardizes operational workflows to reduce manual effort through automated deployment and maintenance processes. It enables elastic resource scaling via vertical and horizontal adjustments to optimize hardware utilization and manages high-availability transitions through automated failover. The platform includes a metadata-driven directory to track physical ma

Patroni is a high availability manager and cluster orchestrator for PostgreSQL. It functions as an automatic failover controller and replication manager that ensures continuous database availability by automating leader election and promoting standby nodes during failures. The system maintains a consistent cluster state by acting as a distributed consensus coordinator. It synchronizes configuration and manages leader elections through integration with distributed configuration stores such as etcd, ZooKeeper, or Consul. Its broader capabilities include managing both synchronous and asynchrono

CloudNativePG is a Kubernetes operator designed for the administration, lifecycle management, and high availability of PostgreSQL database clusters. It functions as a declarative orchestrator that manages database instances through custom resources and manifests. The project distinguishes itself by automating complex operational tasks, including primary election and failover management via streaming physical replication. It provides specialized tools for database version migrations, supporting both offline in-place upgrades and online migrations through logical replication. The operator cove

Flynn is an open-source Platform as a Service (PaaS) that automates the full lifecycle of containerized applications across any infrastructure. It functions as a container orchestration platform, scheduling and managing application containers with isolated filesystem and network stacks, while also providing a health-checked service discovery router that directs traffic only to healthy container instances. The platform is built around a Git-push deployment model, where pushing code to a configured repository triggers an automated build-test-deploy cycle. It supports declarative scaling, allowi

Predis is a PHP library for connecting to and executing commands against Redis and Valkey data stores. It functions as a client for managing data integration, providing dedicated implementations for cluster sharding, pub/sub messaging, and Sentinel-based service discovery. The project distinguishes itself through specialized clients for executing server-side Lua scripts with automated hash caching and a cluster client that supports gossip protocols and key distribution. It also implements a Sentinel client to manage high availability and failover within replicated environments. The library c

ProxySQL is a database proxy designed to route and balance traffic between applications and MySQL or PostgreSQL servers. It provides database high availability by monitoring backend server health and automatically rerouting traffic to healthy nodes during failover events to prevent downtime. The system integrates with generative AI models by proxying requests through a protocol handler, creating a bridge that allows large language models to access structured data. The project includes capabilities for traffic management through automatic failover routing and cluster topology discovery. It op

PikiwiDB is a distributed NoSQL database and disk-based key-value store that serves as a Redis-compatible protocol server. It is designed to handle datasets larger than available system memory by utilizing a persistence engine that stores the full dataset on disk. The system employs a tiered storage model, caching frequently accessed hot data in memory while maintaining the primary volume on disk. It ensures high availability through a replicated data store architecture, using asynchronous binary logs to synchronize data between primary and secondary nodes. The project supports distributed d

Fleet is an open-source device management platform that provides centralized control over computing devices running macOS, Linux, Windows, Chromebooks, iOS, and Android. It enables organizations to enroll devices, collect real-time telemetry, enforce security compliance policies, and manage software remotely from a single system. The platform can be deployed as a single binary, run locally for testing, or scaled horizontally across cloud infrastructure on AWS, Kubernetes, GCP, or Render, with support for high availability through database replication and load balancing. The platform distingui

Orchestrator is a high availability system and replication manager for MySQL database clusters. It functions as a failover automator and topology visualizer designed to detect master failures and promote standby replicas to minimize system downtime. The project focuses on managing and reconfiguring MySQL replication topologies to maintain consistent data distribution. It utilizes topology discovery crawling to map replication structures and identifies active failures within the database cluster. The system provides capabilities for automated cluster recovery, location-aware instance tracking

MySQL replication topology management and HA

AliSQL is a fork of MySQL by Alibaba that extends the relational database management system with enhancements for high performance, scalability, and enterprise-grade availability. It retains the core MySQL identity as a SQL-based database for storing, organizing, and retrieving structured data, while adding optimizations for large-scale transactional and analytical workloads. The project differentiates itself through a set of Alibaba-specific improvements, including a columnar engine for accelerating analytical queries directly on MySQL tables, and a distributed, shared-nothing NDB Cluster en

Pigsty is a comprehensive database infrastructure orchestration platform designed to automate the full lifecycle of high-availability PostgreSQL clusters. It functions as an infrastructure-as-code framework that manages cluster coordination, node provisioning, and service discovery through idempotent playbooks. By integrating distributed consensus mechanisms, the platform ensures automated failover and consistent state enforcement across diverse environments, including bare metal and virtualized infrastructure. The platform distinguishes itself through a robust suite of operational capabiliti

This project is a PostgreSQL Kubernetes operator and database orchestrator designed to automate the deployment, scaling, and lifecycle management of high-availability database clusters. It functions as a controller that uses declarative manifests to provision and synchronize the state of database instances within a cluster. The system manages high availability through streaming replication and ensures constant availability during maintenance via rolling updates. It also serves as a backup and recovery manager, handling point-in-time recovery, logical backups, and cluster cloning using cloud s

m3 उच्च-रिज़ॉल्यूशन मेट्रिक्स और उच्च-कार्डिनैलिटी डेटा प्रबंधन के लिए डिज़ाइन किया गया एक वितरित टाइम सीरीज़ डेटाबेस है। यह एक स्केलेबल स्टोरेज सिस्टम और मल्टी-क्लस्टर क्वेरी इंजन के रूप में कार्य करता है, जो स्टोरेज में कमिट होने से पहले डेटा को डाउनसैंपल और सारांशित करने में सक्षम एक वितरित मेट्रिक्स एग्रीगेटर प्रदान करता है। यह प्रोजेक्ट नोड मेंबरशिप और शार्ड प्लेसमेंट के लिए etcd का उपयोग करके एक समन्वित क्लस्टर मॉडल के माध्यम से खुद को अलग करता है। यह Prometheus रिमोट राइट प्रोटोकॉल, InfluxDB लाइन प्रोटोकॉल और Graphite Carbon प्लेनटेक्स्ट प्रोटोकॉल सहित कई इंजेक्शन प्रोटोकॉल का समर्थन करता है, और PromQL व Graphite के लिए संगत क्वेरी इंटरफेस प्रदान करता है। यह सिस्टम कॉलम-आधारित टाइम सीरीज़ स्टोरेज, सिंक्रोनस डेटा रेप्लिकेशन और वितरित क्वेरी फैन-आउट सहित व्यापक क्षमता क्षेत्रों को कवर करता है। इसमें डेटा लाइफसाइकिल ऑटोमेशन, कोरम-आधारित कंसिस्टेंसी ट्यूनिंग और अलग-अलग नेमस्पेस में डेटा अखंडता व पुनर्प्राप्ति गति बनाए रखने के लिए टैग-आधारित सीरीज़ इंडेक्सिंग शामिल है। क्लस्टर ऑर्केस्ट्रेशन और कंपोनेंट प्लेसमेंट को उच्च उपलब्धता और संतुलित डेटा वितरण सुनिश्चित करने के लिए ऑटोमेटेड टूल्स और ऑपरेटर्स के माध्यम से प्रबंधित किया जाता है।

LiteFS is a FUSE-based distributed file system designed to replicate SQLite databases across a cluster of machines. It functions as a high availability layer that synchronizes data by intercepting write operations to ensure consistency across multiple server nodes. The system manages distributed database storage by mapping file operations to network requests via a user-space driver. This allows for multi-region data synchronization and the distribution of database content to edge nodes, facilitating local reads with synchronized global writes. The replication process utilizes write-ahead log

Stolon is a cloud native database manager and orchestrator for PostgreSQL. It functions as a high availability manager designed to automate failover, replication, and cluster management in distributed environments. The system coordinates synchronous and asynchronous data mirroring and uses a service discovery mechanism to dynamically detect database node addresses. It routes client traffic to the current primary instance through a proxy to maintain application access during role switches. The project covers disaster recovery through point-in-time recovery and the maintenance of multi-site st

Pigsty is a full-stack orchestration suite for deploying, monitoring, and managing high-availability PostgreSQL clusters and their supporting infrastructure. It functions as a cluster management platform and high-availability suite that automates failover, manages virtual IPs, and ensures data consistency through distributed consensus. The project distinguishes itself by providing a comprehensive database infrastructure-as-code framework and a dedicated observability stack. It incorporates a backup and recovery manager supporting point-in-time recovery via S3-compatible object storage, alongs

Atlas एक MySQL डेटाबेस प्रॉक्सी और मिडलवेयर सिस्टम है जिसे डेटाबेस क्लस्टर के बीच ट्रैफ़िक को प्रबंधित करने के लिए डिज़ाइन किया गया है। यह एक उच्च-उपलब्धता डेटाबेस गेटवे और शार्डिंग मिडलवेयर के रूप में कार्य करता है, जो रूटिंग, लोड बैलेंसिंग और डेटाबेस कनेक्शन को प्रबंधित करने के लिए एक फॉल्ट-टोलरेंट एंट्री पॉइंट प्रदान करता है। यह प्रोजेक्ट रीड-राइट स्प्लिटिंग के संयोजन के माध्यम से खुद को अलग करता है, जो क्वेरी को प्राथमिक या प्रतिकृति सर्वर पर निर्देशित करता है, और कई बैकएंड इंस्टेंस में जानकारी वितरित करने के लिए डेटा शार्डिंग करता है। यह नए सत्र स्थापित करने के ओवरहेड को कम करने के लिए कनेक्शन पूलर का उपयोग करता है और क्लाइंट अनुरोधों को इंटरसेप्ट और निर्देशित करने के लिए प्रोटोकॉल-जागरूक रूटिंग लागू करता है। इस सिस्टम में निरंतर सेवा सुनिश्चित करने के लिए स्वास्थ्य निगरानी और स्वचालित फेलओवर की क्षमताएं शामिल हैं। यह बैकएंड सर्वर उपलब्धता पर प्रशासनिक नियंत्रण, एक्सेस कंट्रोल के लिए क्लाइंट IP फ़िल्टरिंग, और सिग्नल-संचालित ट्रैफ़िक डायवर्जन के माध्यम से शून्य-डाउनटाइम अपग्रेड के लिए एक तंत्र का सपोर्ट करता है। ट्रांजेक्शन अखंडता को अप्रत्याशित क्लाइंट डिस्कनेक्ट पर स्वचालित रोलबैक के माध्यम से प्रबंधित किया जाता है।

This project is a Kubernetes operator designed for deploying and managing production PostgreSQL database clusters using declarative configurations. It functions as a controller that synchronizes the actual state of database clusters with a desired state, providing a system for high availability orchestration, automated backup and recovery, and containerized database administration. The operator distinguishes itself through a comprehensive data protection suite that supports point-in-time recovery, multi-mode backups to cloud object storage, and cluster cloning. It ensures continuous availabil