redpanda-data/redpanda

Features

• Data Streaming Platforms - Acts as a high-performance, drop-in replacement for Kafka to simplify event-driven operations.
• Distributed Event Streaming Platforms - Provides a high-throughput distributed engine for processing real-time data streams.
• Real-Time Analytics - Executes analytical queries across live and historical data streams to provide immediate operational insights.
• Real-Time Data Streaming - Transmits real-time data streams between disparate systems to facilitate low-latency communication.
• Kafka-Compatible Deployments - Provisions high-performance clusters that support existing event-driven applications with Kafka compatibility.
• Event-Driven Architectures - Serves as a foundation for building and scaling reliable event-driven applications.
• Agentic Resource Limits - Halts agent operations using automated triggers based on budget thresholds or policy violations to prevent unauthorized actions and excessive resource consumption.
• Data Pipeline Orchestration - Orchestrates scalable data pipelines connecting disparate sources and agents with built-in governance.
• Stream-Oriented Data Pipelines - Provides continuous, real-time streaming pipelines for reliable data movement across distributed environments.
• Storage Tiering - Automatically offloads historical log segments to cost-effective object storage while maintaining a unified view.
• Raft Consensus Implementations - Maintains data consistency and high availability using the Raft consensus algorithm for log replication.
• Thread-Per-Core Architectures - Utilizes a thread-per-core execution model to eliminate lock contention and context switching overhead.
• Event-Driven I/O - Implements a non-blocking event-driven I/O engine to maximize throughput and minimize latency.
• Data Pipelines - Kafka-compatible, ZooKeeper-free streaming platform.
• Data Pipelines and Orchestration - Streaming data platform compatible with the Kafka API.
• Messaging and Event Streaming - Kafka-compatible streaming platform optimized for performance.
• Networking - Kafka-compatible streaming data platform.
• Networking Libraries - Streaming data platform compatible with Kafka API.
• Zero-Copy Memory Mappings - Implements a zero-copy data path using memory mapping to minimize CPU cycles and memory allocation overhead.
• Data Source Connections - Offers connectors to integrate external data sources and destinations for unified information flow.
• Data Stream Integrations - Connects external data sources and destinations to unify information flow across infrastructure.
• Database Protocol Compatibility - Ensures interoperability with existing ecosystem tools through standard binary wire-level protocol compatibility.
• Managed Infrastructure Deployment - Provides tools to provision and manage high-performance data clusters across cloud or self-managed environments.
• Agent Identities - Assigns unique identities and granular, task-specific permissions to individual agents to ensure secure interactions with sensitive data and external system resources.
• Audit Logging Systems - Records immutable logs of system actions to ensure transparency and explainability for all operations.
• Agent Orchestrators - Orchestrates autonomous agent workflows by connecting them to streaming data sources with integrated governance.
• Infrastructure Governance Policies - Applies organizational policies and resource management controls at the infrastructure level to maintain compliance and cost efficiency.

Star history