Awesome GitHub RepositoriesAutomated Master Failovers

This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac

RocketMQ is a cloud-native distributed messaging platform and streaming engine. It functions as a distributed transactional queue that ensures atomicity between local transactions and message delivery, and serves as an MQTT IoT message broker to bridge lightweight device traffic into high-performance data streams. The system is distinguished by a Kubernetes-native architecture that decouples compute from storage to allow independent scaling of traffic and data retention. It utilizes a tiered storage model to offload older data to remote storage and employs quorum-based replication and automat

ioredis is a performance-focused Redis client for Node.js applications. It provides a comprehensive interface for interacting with Redis servers, including specialized clients for sharded clusters and Sentinel-based high availability environments. The project distinguishes itself through advanced networking and execution capabilities, such as automatic event-loop pipelining to reduce overhead and a system for routing read-write traffic between primary and replica nodes. It also features a dedicated Lua scripting interface that allows server-side scripts to be registered as custom client comma

DiceDB is a distributed cache manager and hierarchical storage engine based on a Valkey key-value store. It functions as a high-availability key-value cluster that balances performance and cost by distributing data across memory and disk tiers. The system supports working sets larger than available RAM by persisting evicted keys to disk and restoring them on demand. It also includes a real-time query subscription system that notifies clients when data matching specific criteria is updated. The project provides distributed cache coordination through master node health monitoring and quorum-ba

This project provides a version of the Redis 3.0 codebase featuring detailed technical commentary and annotations. It serves as a technical resource for studying the internal design and implementation of an in-memory key-value store and the architecture of a networked NoSQL database. The documentation focuses on the implementation of the Redis Sentinel system, covering the mechanisms used for monitoring instance health, managing automatic failover, and notifying clients of primary node changes. The project covers broader architectural areas including in-memory data storage, high availability

Patroni is a high availability manager and cluster orchestrator for PostgreSQL. It functions as an automatic failover controller and replication manager that ensures continuous database availability by automating leader election and promoting standby nodes during failures. The system maintains a consistent cluster state by acting as a distributed consensus coordinator. It synchronizes configuration and manages leader elections through integration with distributed configuration stores such as etcd, ZooKeeper, or Consul. Its broader capabilities include managing both synchronous and asynchrono

This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the

CloudNativePG is a Kubernetes operator designed for the administration, lifecycle management, and high availability of PostgreSQL database clusters. It functions as a declarative orchestrator that manages database instances through custom resources and manifests. The project distinguishes itself by automating complex operational tasks, including primary election and failover management via streaming physical replication. It provides specialized tools for database version migrations, supporting both offline in-place upgrades and online migrations through logical replication. The operator cove

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Optimism एक Ethereum ऑप्टिमिस्टिक रोलअप स्टैक है जिसे ट्रांजेक्शन को सेकेंडरी लेयर पर प्रोसेस करके और Ethereum मेननेट पर स्टेट सेटल करके ट्रांजेक्शन थ्रूपुट बढ़ाने के लिए डिज़ाइन किया गया है। यह एक स्केलिंग फ्रेमवर्क के रूप में कार्य करता है जो ट्रांजेक्शन को ऑर्डर करने, ब्लॉक बनाने और बैच किए गए डेटा को प्राइमरी ब्लॉकचेन पर सबमिट करने के लिए रोलअप सीक्वेंसर का उपयोग करता है। इस सिस्टम में एक फ्रॉड प्रूफ सिस्टम है जो विवादों को सुलझाने और स्टेट ट्रांजेक्शन की शुद्धता को सत्यापित करने के लिए ऑन-चेन इंस्ट्रक्शन एमुलेशन का उपयोग करता है। इसमें स्केलिंग नेटवर्क को बूटस्ट्रैप और मेंटेन करने के लिए आवश्यक स्मार्ट कॉन्ट्रैक्ट्स को डिप्लॉय और अपग्रेड करने के लिए एक समर्पित टूलसेट शामिल है। यह प्रोजेक्ट ब्लॉकचेन स्टेट सिंक्रोनाइज़ेशन, क्रॉस-चेन मैसेज रूटिंग और हाई-अवेलेबिलिटी फेलओवर के साथ सीक्वेंसर एडमिनिस्ट्रेशन सहित व्यापक क्षमताओं को कवर करता है। यह डेटा अवेलेबिलिटी, फॉल्ट प्रूफ जनरेशन और ब्लॉकचेन कंपोनेंट्स विकसित करने के लिए एक सर्विस-ओरिएंटेड फ्रेमवर्क के लिए इंफ्रास्ट्रक्चर भी प्रदान करता है। रिपॉजिटरी में सिस्टम व्यवहार और अपग्रेड स्थिरता को मान्य करने के लिए अकाउंट मैनेजमेंट, नेटवर्क सिमुलेशन और इंटीग्रेशन टेस्टिंग के लिए यूटिलिटीज के साथ एक डेवलपमेंट किट शामिल है।

Orchestrator is a high availability system and replication manager for MySQL database clusters. It functions as a failover automator and topology visualizer designed to detect master failures and promote standby replicas to minimize system downtime. The project focuses on managing and reconfiguring MySQL replication topologies to maintain consistent data distribution. It utilizes topology discovery crawling to map replication structures and identifies active failures within the database cluster. The system provides capabilities for automated cluster recovery, location-aware instance tracking

MySQL replication topology management and HA

Pigsty is a comprehensive database infrastructure orchestration platform designed to automate the full lifecycle of high-availability PostgreSQL clusters. It functions as an infrastructure-as-code framework that manages cluster coordination, node provisioning, and service discovery through idempotent playbooks. By integrating distributed consensus mechanisms, the platform ensures automated failover and consistent state enforcement across diverse environments, including bare metal and virtualized infrastructure. The platform distinguishes itself through a robust suite of operational capabiliti

Keepalived एक उच्च उपलब्धता प्रबंधक और वर्चुअल IP फेलओवर टूल है जो निरंतर सेवा उपलब्धता सुनिश्चित करता है। यह राउटर अतिरेक और निर्बाध फेलओवर को मैनेज करने के लिए वर्चुअल राउटर रिडंडेंसी प्रोटोकॉल का उपयोग करके मास्टर और बैकअप नोड्स के बीच फ्लोटिंग IP पतों के माइग्रेशन को समन्वित करता है। यह प्रोजेक्ट ट्रांसपोर्ट-लेयर लोड बैलेंसर के रूप में कार्य करने के लिए Linux कर्नेल IPVS मॉड्यूल के साथ एकीकृत होकर खुद को अलग करता है। यह NAT, डायरेक्ट रूटिंग या टनलिंग जैसे विभिन्न शेड्यूलिंग एल्गोरिदम और फॉरवर्डिंग विधियों का उपयोग करके बैकएंड सर्वर पर नेटवर्क ट्रैफ़िक वितरित करता है। सिस्टम में मिलीसेकंड में विफलताओं की पहचान करने के लिए TCP, HTTP और बिडायरेक्शनल फॉरवर्डिंग डिटेक्शन प्रोटोकॉल का उपयोग करके नेटवर्क स्वास्थ्य निगरानी क्षमताएं शामिल हैं। यह कस्टम स्क्रिप्ट्स के निष्पादन, SMTP प्रशासनिक अलर्ट और कई इंस्टेंस में रूटिंग पथों के सिंक्रोनाइज़ेशन के माध्यम से ऑटोमेटेड फेलओवर ऑर्केस्ट्रेशन का समर्थन करता है। सॉफ्टवेयर एक कॉन्फ़िगरेशन सतह प्रदान करता है जो टेम्प्लेटाइज़ेशन, नेटवर्क नेमस्पेस आइसोलेशन और SNMP के माध्यम से सिस्टम मेट्रिक्स के एक्सपोर्ट का समर्थन करता है।

This project is a Kubernetes operator designed for deploying and managing production PostgreSQL database clusters using declarative configurations. It functions as a controller that synchronizes the actual state of database clusters with a desired state, providing a system for high availability orchestration, automated backup and recovery, and containerized database administration. The operator distinguishes itself through a comprehensive data protection suite that supports point-in-time recovery, multi-mode backups to cloud object storage, and cluster cloning. It ensures continuous availabil

Ergo is a distributed actor framework for Go that implements the Erlang distribution protocol, enabling the construction of resilient, concurrent applications that can communicate transparently with Erlang/OTP nodes. At its core, it provides an actor model with isolated lightweight processes, priority-ordered mailboxes, and a meta-process architecture that separates blocking I/O from sequential message handling to prevent actor freezing. The framework includes a Raft-inspired cluster consensus system for leader election and automatic failover, along with OTP-style supervision trees that organi

Raft is a Go library implementing the Raft consensus protocol for coordinating reliable state machine replication across a cluster. It functions as a distributed systems library for building applications that require strongly consistent replicated state, keeping distributed nodes synchronized and fault-tolerant through automated node elections and log distribution. The library conducts periodic node elections using majority votes to designate a single data authority and prevent split-brain conflicts, while distributing deterministic command logs from leaders to follower nodes using a multi-ph

Raft is a portable C programming library that implements the Raft distributed consensus protocol. It serves as a state machine replication engine and coordination primitive for building fault-tolerant distributed applications and clustered systems. The library manages leader election timeouts, heartbeat monitoring, and log replication across peer nodes to maintain consistent state across servers. It handles client write operations, redirects requests from non-leader nodes, processes voting and replication messages, and supports dynamic cluster membership changes through specialized log entri