riemann/riemann
Riemann
Riemann is a Clojure-based event stream processor and real-time analytics engine. It functions as a network telemetry pipeline and extensible event router that ingests, transforms, and routes event data from distributed systems.
The system uses a domain-specific language to compute metrics and statistical patterns over continuous streams, enabling network trend analysis and real-time alerting. It supports dynamic plugin loading from the classpath and allows for live configuration reloading without interrupting active event streams.
Capabilities include centralized telemetry aggregation, event metadata tagging, and stateful event indexing. The system handles the dispatch of event flows through splitting, batching, and filtering, while providing secure network transport via encryption and authentication.
Features
- Network Stream Analytics - Analyzes continuous streams of network data to derive real-time insights and metrics from distributed systems.
- Network Event Analytics - Analyzes continuous network event streams in real time to derive operational insights and trigger system alerts.
- Streaming Processors - Provides a stream processing engine that ingests, transforms, and routes network event data using a domain-specific language.
- Stream Processing - Implements a sequential chain of transformation functions for the continuous ingestion, transformation, and analysis of network data streams.
- Distributed Event Routers - Functions as an extensible router that dispatches event data streams to diverse destinations based on matching patterns.
- Stream Transformations - Transforms event streams using complex operations including linear prediction, rate calculation, and event coalescing.
- Event Tagging - Applies custom metadata labels to events to organize and filter telemetry streams based on specific attributes.
- Multi-Destination Event Routing - Routes processed event data to multiple external monitoring and alerting destinations based on custom rules.
- Stream Analytics Processing - Uses a domain-specific language to calculate rolling aggregates and statistical metrics over real-time data streams.
- Real-Time Event Processing - Performs continuous computation of metrics and statistical patterns over event streams to enable immediate alerting.
- Telemetry Data Pipelines - Implements a high-volume data pipeline for the ingestion, processing, and forwarding of real-time network telemetry.
- Event Ingestion - Provides pipelines for capturing and normalizing incoming telemetry data from network sockets and message queues.
- Telemetry Event Routing - Directs and filters network event flows to different external monitoring tools based on metadata and custom rules.
- State Tracking - Maintains an index of recent events to track the current status of distributed hosts and detect state changes.
- Real-time Event Triggers - Monitors event streams to immediately trigger alerts and automated actions upon detection of critical system failures.
- Centralized Metric Streaming - Provides centralized collection and streaming of telemetry from multiple distributed agents for unified analysis.
- Socket-Based Ingestion - Receives raw telemetry data via TCP and UDP network sockets for downstream stream analysis.
- Telemetry Collection and Aggregation - Collects and unifies telemetry data from multiple servers and applications for centralized analysis.
- Trend Analysis - Computes statistical patterns and metrics over event streams to track and alert on performance shifts over time.
- Event Data Forwarding - Forwards processed telemetry and monitoring events to external search clusters or cloud tables for long-term analysis.
- External Data Routing - Directs event streams to external message brokers or data sinks to notify teams of critical issues.
- Event State Indexes - Maintains an in-memory index of recent events to track host status and detect changes across streams.
- Runtime Plugin Loading - Dynamically loads Clojure namespaces and plugins from the classpath at runtime to extend system capabilities.
- Live Configuration Reloads - Updates processing rules and system settings in real time without interrupting active event streams.
- Action Triggers - Executes custom scripts or sends external notifications when specific event-driven conditions are met.
- Network Transmission Security - Ensures secure transport of event data using encryption and authentication for servers and API integrations.
- Event State Persistence - Tracks and persists the most recent events in memory to maintain analytical continuity across system reloads.
- Telemetry Tool Integrations - Connects and synchronizes telemetry data across a variety of disparate monitoring and alerting tools.
- Data Collection Agents - Network event stream processing system.
- Monitoring and Status - Event processor for complex metrics analysis.
- Monitoring Systems - Event processor for complex metrics analysis.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
