Awesome GitHub RepositoriesSharding Proxies

This repository contains the technical specification and architectural blueprint for a decentralized network protocol designed to coordinate autonomous agents. It defines a system model for a global autonomous agentic internet, covering protocol engineering, tokenomics, and the structural design of the network infrastructure. The protocol focuses on a programmable payment system that utilizes trustless atomic swaps and specific spending conditions to release funds. It incorporates a privacy-preserving framework for off-chain transaction execution, allowing service providers and users to maint

Codis is a distributed proxy system designed for scaling Redis clusters. It provides a sharding proxy that distributes data across multiple instances and a cluster manager to oversee the environment. The system enables horizontal scaling through dynamic resharding, which allows data slots to be migrated between servers without interrupting operations. It supports multi-key atomic operations using hash tags to ensure related keys are routed to the same server. The platform includes a graphical cluster management dashboard for monitoring and administration. It implements high availability prox

Mycat-Server is a MySQL database middleware system that functions as a sharding proxy, distributed database coordinator, and high availability manager. It acts as a proxy layer that routes SQL traffic between applications and multiple backend MySQL database instances to enable horizontal scaling. The system coordinates distributed transactions, generates global unique sequences to prevent primary key collisions, and executes distributed join queries across multiple database shards. It includes a load balancer that performs read-write splitting by directing traffic between primary and slave no

Pgcat ist eine PostgreSQL-Middleware-Lösung für Connection Pooling, Sharding, Load Balancing und Failover-Management. Sie fungiert als Proxy, der die Ressourcennutzung und Skalierbarkeit optimiert, indem er Datenbanksitzungen verwaltet und Abfragen auf mehrere Instanzen verteilt. Das System zeichnet sich durch Traffic-Mirroring aus, bei dem Live-Produktionsabfragen zur Validierung an Testdatenbanken dupliziert werden. Zudem implementiert es einen Sharding-Proxy, um Daten und Abfragen basierend auf Sharding-Keys auf mehrere Datenbankinstanzen zu verteilen. Das Projekt deckt Hochverfügbarkeit durch automatisiertes Failover und Server-Health-Monitoring ab. Es umfasst Traffic-Routing zur Trennung von Lese- und Schreiboperationen, Transport Layer Security für verschlüsselte Kommunikation sowie eine virtuelle administrative Datenbank für das Systemmanagement und den Export von Leistungsmetriken. Der Dienst wird als Docker-Container bereitgestellt, um eine konsistente Bereitstellung in verschiedenen Umgebungen zu gewährleisten.

RavenDB is a multi-model NoSQL document database designed for high-performance, ACID-compliant data storage. It persists structured information as schema-flexible JSON documents and utilizes a unit-of-work session pattern to track entity changes and batch modifications into atomic transactions. The platform is built on a distributed architecture that supports horizontal scaling through sharding and ensures high availability via multi-node, master-to-master cluster replication. The database distinguishes itself through a self-optimizing query engine that automatically creates and maintains ind

pgdog is a PostgreSQL sharding proxy, distributed SQL router, and connection pooler. It is designed to enable horizontal data distribution by splitting tables and indices across multiple independent servers to scale storage and processing capacity. The project distinguishes itself through online resharding capabilities, using logical replication to move data between shards without application downtime. It supports multiple routing strategies, including hash, list, and range-based query routing, and manages distributed atomic transactions using a two-phase commit process to ensure consistency