# redpanda-data/redpanda

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/redpanda-data-redpanda).**

11,749 stars · 718 forks · C++

## Links

- GitHub: https://github.com/redpanda-data/redpanda
- Homepage: https://redpanda.com
- awesome-repositories: https://awesome-repositories.com/repository/redpanda-data-redpanda.md

## Topics

`containers` `cpp` `event-driven` `go` `kafka` `kubernetes` `microservices` `realtime` `redpanda` `seastar` `storage-engine` `stream-processing` `streaming`

## Description

Redpanda is a distributed event streaming engine designed to serve as a high-performance, drop-in replacement for existing event-driven architectures. It provides a foundation for building and scaling applications that require reliable data movement, analytical querying, and strict operational compliance across both cloud and self-managed environments.

The platform distinguishes itself through a shared-nothing architecture that utilizes thread-per-core execution and a non-blocking asynchronous input/output engine to maximize throughput. It maintains data consistency through a consensus-based replication model and implements binary protocol compatibility, allowing existing ecosystem tools to interact with the system without modification. To optimize resource usage, the platform features a zero-copy data path and automated tiered storage that offloads historical log segments to object storage while maintaining a unified view for consumers.

Beyond core streaming, the platform includes integrated governance and orchestration capabilities for connecting autonomous agents to data flows. It provides granular identity management and execution controls to secure agent interactions, alongside auditing tools that record immutable logs of system actions. The infrastructure also supports real-time analytical querying across live and historical data streams to facilitate immediate operational insights.

## Tags

### Data & Databases

- [Data Streaming Platforms](https://awesome-repositories.com/f/data-databases/data-streaming-platforms.md) — Acts as a high-performance, drop-in replacement for Kafka to simplify event-driven operations.
- [Distributed Event Streaming Platforms](https://awesome-repositories.com/f/data-databases/distributed-event-streaming-platforms.md) — Provides a high-throughput distributed engine for processing real-time data streams.
- [Real-Time Analytics](https://awesome-repositories.com/f/data-databases/real-time-analytics.md) — Executes analytical queries across live and historical data streams to provide immediate operational insights. ([source](https://www.redpanda.com/))
- [Real-Time Data Streaming](https://awesome-repositories.com/f/data-databases/real-time-data-streaming.md) — Transmits real-time data streams between disparate systems to facilitate low-latency communication. ([source](https://www.redpanda.com/))
- [Data Pipeline Orchestration](https://awesome-repositories.com/f/data-databases/data-pipeline-orchestration.md) — Orchestrates scalable data pipelines connecting disparate sources and agents with built-in governance.
- [Stream-Oriented Data Pipelines](https://awesome-repositories.com/f/data-databases/data-processing-pipelines/stream-processing-systems/data-streaming/stream-oriented-data-pipelines.md) — Provides continuous, real-time streaming pipelines for reliable data movement across distributed environments. ([source](https://redpanda.com/documentation))
- [Storage Tiering](https://awesome-repositories.com/f/data-databases/storage-tiering.md) — Automatically offloads historical log segments to cost-effective object storage while maintaining a unified view.
- [Zero-Copy Memory Mappings](https://awesome-repositories.com/f/data-databases/data-engineering-infrastructure/data-persistence-storage/data-storage-architectures/zero-copy-memory-mappings.md) — Implements a zero-copy data path using memory mapping to minimize CPU cycles and memory allocation overhead.
- [Data Source Connections](https://awesome-repositories.com/f/data-databases/data-integration-synchronization/data-integration/data-source-connections.md) — Offers connectors to integrate external data sources and destinations for unified information flow. ([source](https://www.redpanda.com/))
- [Data Stream Integrations](https://awesome-repositories.com/f/data-databases/data-stream-integrations.md) — Connects external data sources and destinations to unify information flow across infrastructure.
- [Database Protocol Compatibility](https://awesome-repositories.com/f/data-databases/database-protocol-compatibility.md) — Ensures interoperability with existing ecosystem tools through standard binary wire-level protocol compatibility.

### DevOps & Infrastructure

- [Kafka-Compatible Deployments](https://awesome-repositories.com/f/devops-infrastructure/cloud-infrastructure-deployment/managed-infrastructure-deployment/kafka-compatible-deployments.md) — Provisions high-performance clusters that support existing event-driven applications with Kafka compatibility.
- [Managed Infrastructure Deployment](https://awesome-repositories.com/f/devops-infrastructure/cloud-infrastructure-deployment/managed-infrastructure-deployment.md) — Provides tools to provision and manage high-performance data clusters across cloud or self-managed environments. ([source](https://redpanda.com/documentation))
- [Infrastructure Governance Policies](https://awesome-repositories.com/f/devops-infrastructure/infrastructure-governance-policies.md) — Applies organizational policies and resource management controls at the infrastructure level to maintain compliance and cost efficiency. ([source](https://www.redpanda.com/))

### Software Engineering & Architecture

- [Event-Driven Architectures](https://awesome-repositories.com/f/software-engineering-architecture/event-driven-architectures.md) — Serves as a foundation for building and scaling reliable event-driven applications.
- [Thread-Per-Core Architectures](https://awesome-repositories.com/f/software-engineering-architecture/performance-reliability/performance-optimization-patterns/thread-per-core-architectures.md) — Utilizes a thread-per-core execution model to eliminate lock contention and context switching overhead.

### Artificial Intelligence & ML

- [Agentic Resource Limits](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/integration-deployment/agent-frameworks/tool-use-and-execution/agent-tool-execution/execution-control-policies/agentic-resource-limits.md) — Halts agent operations using automated triggers based on budget thresholds or policy violations to prevent unauthorized actions and excessive resource consumption. ([source](https://www.redpanda.com/))
- [Agent Orchestrators](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-orchestrators.md) — Orchestrates autonomous agent workflows by connecting them to streaming data sources with integrated governance. ([source](https://redpanda.com/documentation))

### Networking & Communication

- [Raft Consensus Implementations](https://awesome-repositories.com/f/networking-communication/distributed-systems-p2p/distributed-systems-coordination/distributed-consensus-protocols/raft-consensus-implementations.md) — Maintains data consistency and high availability using the Raft consensus algorithm for log replication.

### System Administration & Monitoring

- [Event-Driven I/O](https://awesome-repositories.com/f/system-administration-monitoring/administrative-operations/linux-system-administration/networking/connection-lifecycle-management/parallel-network-i-o/event-driven-i-o.md) — Implements a non-blocking event-driven I/O engine to maximize throughput and minimize latency.
- [Audit Logging Systems](https://awesome-repositories.com/f/system-administration-monitoring/audit-logging-systems.md) — Records immutable logs of system actions to ensure transparency and explainability for all operations. ([source](https://www.redpanda.com/))

### Security & Cryptography

- [Agent Identities](https://awesome-repositories.com/f/security-cryptography/identity-and-access-management/agent-identities.md) — Assigns unique identities and granular, task-specific permissions to individual agents to ensure secure interactions with sensitive data and external system resources. ([source](https://www.redpanda.com/))