linkedin/Burrow
Burrow
Burrow هي خدمة مراقبة وتنبيه لمجموعات Kafka. تتتبع تأخر مجموعة المستهلكين (consumer group lag) من خلال تقييم الإزاحات الملتزم بها وتحديد الفجوة بين الرسائل المنتجة والمستهلكة.
يحسب النظام تأخيرات المعالجة باستخدام تقييم إزاحة النافذة المنزلقة ويراقب صحة المجموعة بشكل عام. عندما تستوفي ظروف مجموعة المستهلكين عتبات محددة مسبقاً، فإنه يطلق إشعارات للخدمات الخارجية عبر البريد الإلكتروني أو webhooks.
توفر الخدمة نقاط نهاية HTTP للاستعلام عن معلومات الوسيط وحالة مجموعة المستهلكين، مما يسمح للأدوات الخارجية باستطلاع صحة النظام ومقاييس الأداء.
Features
- Kafka Cluster Health Monitors - Provides real-time metrics and health status of Kafka brokers and consumer groups through a dedicated API.
- Consumer Lag Monitoring - Tracks the delay between produced and consumed messages in Kafka to identify processing bottlenecks and system latency.
- Offset Metadata Retrievers - Fetches current offset positions directly from Kafka brokers to determine the gap between production and consumption.
- Sliding-Window Evaluators - Calculates consumer lag by tracking committed offsets over a specific time interval to detect processing delays.
- Stream Offset Tracking - Evaluates committed offsets over a sliding window to determine if consumer groups are keeping up with data streams.
- Event-Driven Notification Triggers - Dispatches alerts to external services immediately when Kafka consumer group conditions cross predefined threshold limits.
- Message Broker Monitoring - Monitors the gap between the last produced and last consumed message to detect processing bottlenecks.
- Kafka Alerting Integrations - Sends notifications to external services when Kafka consumer groups meet specific error or delay conditions.
- Monitoring Alerting Systems - Implements a notification engine that triggers email or web call alerts based on Kafka consumer lag thresholds.
- Event-Triggered Alert Deliveries - Triggers configurable alarms via email or web-calls when specific Kafka consumer group lag conditions are met.
- Polling-Based Health Monitors - Exposes an on-demand HTTP endpoint that allows external monitoring tools to poll for system health and broker information.
- Webhook Notifications - Sends automated HTTP webhook calls to third-party services when consumer lag conditions are met.
- Broker HTTP Endpoints - Provides HTTP endpoints within the service to retrieve broker information and consumer group status for health monitoring.
