Awesome GitHub RepositoriesMessage Queue Metric Consumption

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Telegraf is a modular, cross-platform telemetry pipeline designed to collect, process, and route metrics from diverse infrastructure, applications, and hardware. It functions as a server-side middleware that normalizes heterogeneous data into a unified format, enabling consistent monitoring across complex environments. By utilizing a plugin-driven architecture, the agent manages the entire lifecycle of telemetry data from initial ingestion to final transmission. The project distinguishes itself through a declarative, configuration-driven execution model that allows users to define complex dat

VictoriaMetrics is a high-performance, scalable time series database and observability platform designed for long-term storage and analysis of metric, log, and trace data. It functions as a unified backend for monitoring ecosystems, offering full compatibility with industry-standard protocols and query languages. The system is built to handle massive data volumes through a distributed architecture that supports horizontal scaling and efficient data lifecycle management. The platform distinguishes itself through a storage engine that utilizes consistent hashing for data sharding and log-struct

FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified abstraction layer for interacting with various message brokers, enabling developers to manage event production and consumption through a consistent interface while maintaining access to native provider-specific features. The framework centers on a decorator-based routing model that binds application logic directly to broker topics, supported by a built-in dependency injection container that resolves resources at runtime. The framework distinguishes itself through its deep int

KafkaJS هو عميل JavaScript خالص لـ Apache Kafka، يوفر الأدوات اللازمة لإنتاج واستهلاك الرسائل من مجموعة Kafka دون الحاجة إلى تبعيات أصلية أو إضافات خارجية. يعمل كمكتبة تكامل شاملة لتطبيقات Node.js للمشاركة في معالجة الرسائل الموزعة وبث الأحداث في الوقت الفعلي. يتميز المشروع بتنفيذه الأصلي لبروتوكول سلك Kafka، متجنباً تبعيات C++. يتميز بعميل أمان يدعم مصادقة SSL وTLS وSASL، إلى جانب قدرات المعاملات التي تسمح بإرسال الرسائل الذري والالتزامات المرتبطة بالإزاحة لضمان المعالجة مرة واحدة بالضبط. تغطي المكتبة مجموعة واسعة من المجالات التشغيلية، بما في ذلك إدارة المجموعة الكاملة لإدارة المواضيع ومجموعات المستهلكين، واستراتيجيات توجيه وتعيين الأقسام المتقدمة، والقياس عن بعد الشامل عبر المراقبة القائمة على الأحداث. كما تنفذ أنماط موثوقية الشبكة مثل عمليات إعادة المحاولة ذات التراجع الأسي وجلب البيانات المدرك للرف لتحسين زمن الوصول.