Awesome GitHub RepositoriesBroker Node Identities

Longhorn is a distributed block storage system and orchestrator for Kubernetes. It provides persistent, replicated block storage volumes that survive pod restarts and node failures by maintaining synchronous copies of data across multiple cluster nodes. The system implements the Container Storage Interface (CSI) for dynamic volume provisioning and attachment. It is distinguished by its support for shared read-write access to a single block volume across multiple pods, as well as the ability to export volume snapshots to external S3 or NFS targets for off-cluster disaster recovery. The platfo

This project provides a containerized distribution of Apache Kafka for deploying distributed messaging brokers and event streaming platforms. It functions as a cluster orchestrator that enables the launch of interconnected brokers to establish high-throughput data pipelines. The system uses environment variables to automate topic provisioning and configure broker parameters during the container boot sequence. It manages network listener mapping and advertised hostnames to facilitate client connectivity across different networks. Capability areas include cluster deployment, broker scaling man

Agones is a Kubernetes game server orchestrator designed for hosting, scaling, and managing dedicated multiplayer game servers. It extends the Kubernetes control plane using custom resource definitions to define game server and fleet objects, utilizing a dedicated fleet manager to maintain pools of warm server instances. The system provides a game server SDK and language-specific client libraries that allow server processes to signal readiness, health, and shutdown states directly to the controller. It distinguishes itself through specialized scaling logic, including the use of WebAssembly mo

kafka-python is a pure-Python client library for Apache Kafka that implements the Kafka wire protocol directly, without any native bindings or JVM dependencies. It provides the core capabilities of a Kafka client: producing messages to topics, consuming records from topics, and administering cluster resources such as topics and partitions, all through a Pythonic API or command-line tools. The library distinguishes itself through its comprehensive support for advanced Kafka features. It includes an asynchronous producer with background batching for throughput, a consumer group rebalance protoc

Strimzi is a Kubernetes operator that automates the deployment, management, and lifecycle of Apache Kafka clusters on Kubernetes or OpenShift. It uses custom resource definitions and declarative YAML configuration to define Kafka cluster topology, broker placement, and security settings, with operator-based controllers that reconcile the desired state with the actual cluster state. The operator handles rolling updates during cluster upgrades or configuration changes to maintain availability and data integrity, and supports rack-aware broker scheduling across Kubernetes nodes and availability

Pigsty este o platformă cuprinzătoare de orchestrare a infrastructurii de baze de date concepută pentru a automatiza întregul ciclu de viață al clusterelor PostgreSQL de înaltă disponibilitate. Acesta funcționează ca un framework de tip infrastructure-as-code care gestionează coordonarea clusterului, provizionarea nodurilor și descoperirea serviciilor prin playbook-uri idempotente. Prin integrarea mecanismelor de consens distribuit, platforma asigură failover-ul automat și impunerea stării consistente în medii diverse, inclusiv bare metal și infrastructură virtualizată. Platforma se distinge printr-o suită robustă de capabilități operaționale care se extind dincolo de gestionarea standard a bazelor de date. Dispune de un pipeline de observabilitate încorporat care agregă metrici, log-uri și urme în dashboard-uri centralizate pentru monitorizarea performanței în timp real și analiză diagnostică. În plus, oferă un framework de migrare care emulează protocoalele wire proprietare și sintaxa SQL, permițând integrarea sarcinilor de lucru ale bazelor de date enterprise legacy în medii relaționale moderne. Sistemul acoperă o suprafață funcțională largă, inclusiv gestionarea avansată a stocării cu clonare copy-on-write pentru implementare rapidă și orchestrarea multi-bază de date care coordonează motoarele relaționale cu caching-ul și serviciile de stocare a obiectelor. De asemenea, încorporează securizarea, backup-ul și recuperarea automată și rutarea traficului prin proxy-uri stratificate pentru a decupla conexiunile clienților de topologia clusterului subiacent. Proiectul este distribuit ca un model de oglindire a pachetelor auto-conținut, permițând implementarea consistentă și gestionarea dependențelor în medii securizate sau izolate (air-gapped).

KafkaJS is a pure JavaScript client for Apache Kafka, providing the necessary tools to produce and consume messages from a Kafka cluster without requiring native dependencies or external addons. It functions as a comprehensive integration library for Node.js applications to engage in distributed message processing and real-time event streaming. The project is distinguished by its native implementation of the Kafka wire protocol, avoiding C++ dependencies. It features a security client supporting SSL, TLS, and SASL authentication, alongside transactional capabilities that allow for atomic mess