Awesome GitHub RepositoriesMessage Queue Metric Consumption

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Telegraf is a modular, cross-platform telemetry pipeline designed to collect, process, and route metrics from diverse infrastructure, applications, and hardware. It functions as a server-side middleware that normalizes heterogeneous data into a unified format, enabling consistent monitoring across complex environments. By utilizing a plugin-driven architecture, the agent manages the entire lifecycle of telemetry data from initial ingestion to final transmission. The project distinguishes itself through a declarative, configuration-driven execution model that allows users to define complex dat

VictoriaMetrics is a high-performance, scalable time series database and observability platform designed for long-term storage and analysis of metric, log, and trace data. It functions as a unified backend for monitoring ecosystems, offering full compatibility with industry-standard protocols and query languages. The system is built to handle massive data volumes through a distributed architecture that supports horizontal scaling and efficient data lifecycle management. The platform distinguishes itself through a storage engine that utilizes consistent hashing for data sharding and log-struct

FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified abstraction layer for interacting with various message brokers, enabling developers to manage event production and consumption through a consistent interface while maintaining access to native provider-specific features. The framework centers on a decorator-based routing model that binds application logic directly to broker topics, supported by a built-in dependency injection container that resolves resources at runtime. The framework distinguishes itself through its deep int

KafkaJS 是一个纯 JavaScript 编写的 Apache Kafka 客户端，提供了从 Kafka 集群生产和消费消息所需的必要工具，无需原生依赖或外部插件。它作为 Node.js 应用程序参与分布式消息处理和实时事件流的综合集成库。 该项目以其对 Kafka 有线协议的原生实现而著称，避免了 C++ 依赖。它具有支持 SSL、TLS 和 SASL 身份验证的安全客户端，以及允许原子消息发送和链接偏移量提交的事务功能，以确保精确一次 (exactly-once) 处理。 该库涵盖了广泛的运营领域，包括用于管理主题和消费者组的完整集群管理、高级分区路由和分配策略，以及通过事件驱动监控实现的全面遥测。它还实现了网络可靠性模式，例如指数退避重试和机架感知数据获取，以优化延迟。