Awesome GitHub RepositoriesDistributed Event Routers

Fluentd is a unified logging layer and distributed event router that collects, parses, and routes log data from diverse sources to various storage backends. It functions as a log forwarding agent and pipeline orchestrator, transforming raw unstructured log strings into formatted objects using structured log parsing. The project utilizes a plugin-based pipeline architecture to route data through independent input, filter, and output stages. It differentiates itself through tag-based event routing, which uses regular expression patterns to direct specific data streams to their intended destinat

Watermill is a Go library for building event-driven applications. It provides a framework for implementing event-driven architectures through a consistent interface for message publishing and subscribing, featuring a pub/sub message router and event stream processing pipelines. The library uses interface-based abstractions to decouple message producers and consumers from the underlying message broker. This allows different messaging technologies to be swapped via plugin-based broker integration. It employs a router-driven dispatch system and middleware-based pipelines to manage cross-cutting

Moleculer is a Node.js microservices framework designed for building distributed systems. It functions as a distributed service broker, task orchestrator, and service mesh framework, enabling a decentralized architecture with built-in service discovery and load balancing. The project differentiates itself through a pluggable transport layer supporting protocols such as NATS, Redis, TCP, and Kafka, as well as a dedicated microservices API gateway that maps external HTTP and WebSocket requests to internal service actions. It includes built-in fault tolerance mechanisms, including circuit breake

Riemann est un moteur d'analyse en temps réel et un processeur de flux d'événements basé sur Clojure. Il fonctionne comme un pipeline de télémétrie réseau et un routeur d'événements extensible qui ingère, transforme et achemine les données d'événements provenant de systèmes distribués. Le système utilise un langage dédié (DSL) pour calculer des métriques et des modèles statistiques sur des flux continus, permettant l'analyse des tendances réseau et l'alerte en temps réel. Il prend en charge le chargement dynamique de plugins depuis le classpath et permet de recharger la configuration à chaud sans interrompre les flux d'événements actifs. Ses capacités incluent l'agrégation centralisée de télémétrie, le marquage de métadonnées d'événements et l'indexation d'événements avec état. Le système gère la répartition des flux d'événements par fractionnement, traitement par lots et filtrage, tout en assurant un transport réseau sécurisé via chiffrement et authentification.

Databus is a distributed change data capture system and database transaction log streamer. It extracts data modifications from source logs and streams them to downstream consumers to keep secondary data stores and caches consistent. The system functions as a source-agnostic data pipeline and distributed event relay. It uses a network of processes to decouple database sources from consumers, routing change streams across a network to multiple targets regardless of the original source system. The project covers real-time data synchronization and distributed pipeline monitoring. This includes t