# apache/incubator-pulsar **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/apache-incubator-pulsar).** 15,270 stars · 3,738 forks · Java · Apache-2.0 ## Links - GitHub: https://github.com/apache/incubator-pulsar - Homepage: https://pulsar.apache.org/ - awesome-repositories: https://awesome-repositories.com/repository/apache-incubator-pulsar.md ## Description Apache Pulsar is a cloud-native message queue and distributed publish-subscribe messaging system. It serves as a multi-tenant event streaming platform designed to route data streams for asynchronous communication between producers and consumers. The system distinguishes itself through geo-replication, synchronizing data across multiple geographic regions to ensure high availability and low latency. It implements a multi-tenant architecture that provides isolation and resource management for millions of independent topics. The platform covers high-throughput data streaming and event-driven data pipelines. Its capabilities include maintaining message ordering, managing multi-tenant access, and offloading cold data to tiered storage. System administration and resource provisioning are handled via a programmatic REST API. ## Tags ### Part of an Awesome List - [Message Queues](https://awesome-repositories.com/f/awesome-lists/devops/message-queues.md) — Provides a cloud-native, scalable message queue that separates storage from serving for independent scaling. - [Queue and Messaging](https://awesome-repositories.com/f/awesome-lists/devops/queue-and-messaging.md) — Provides reliable message queueing semantics to ensure data delivery across a distributed cluster. ([source](https://github.com/apache/incubator-pulsar#readme)) - [Data Pipelines](https://awesome-repositories.com/f/awesome-lists/data/data-pipelines.md) — Distributed pub-sub messaging platform. ### Networking & Communication - [Publish-Subscribe Messaging](https://awesome-repositories.com/f/networking-communication/communication-platforms-services/messaging-notification-systems/messaging-services/message-broker-infrastructure/publish-subscribe-messaging.md) — Implements a distributed publish-subscribe model for asynchronous communication between producers and consumers. ([source](https://github.com/apache/incubator-pulsar#readme)) - [Pub-Sub Messaging](https://awesome-repositories.com/f/networking-communication/pub-sub-messaging.md) — Decouples message producers and consumers using topics and channels for asynchronous communication. - [Message Ordering Guarantees](https://awesome-repositories.com/f/networking-communication/network-reliability-diagnostics/reliability-scaling/message-ordering-guarantees.md) — Ensures messages arrive at the consumer in the exact sequence they were sent to preserve data consistency. ([source](https://github.com/apache/incubator-pulsar#readme)) ### Data & Databases - [Event-Driven Data Pipelines](https://awesome-repositories.com/f/data-databases/data-integration-synchronization/event-driven-data-pipelines.md) — Provides reactive systems that route and buffer messages in a reliable sequence between distributed components. - [Regional Replication](https://awesome-repositories.com/f/data-databases/distributed-data-synchronization-systems/regional-replication.md) — Implements synchronization of message data across geographically distinct locations to ensure global availability and disaster recovery. - [High-Throughput Data Streaming](https://awesome-repositories.com/f/data-databases/high-throughput-data-streaming.md) — Optimizes the continuous flow and processing of massive volumes of event data across millions of topics. - [Event Stream Isolation](https://awesome-repositories.com/f/data-databases/multi-tenant-data-management/event-stream-isolation.md) — Provides built-in isolation and resource management for millions of independent topics across multiple tenants. - [Multi-Tenant Resource Isolation](https://awesome-repositories.com/f/data-databases/multi-tenant-resource-isolation.md) — Groups topics into namespaces with specific policies for quotas and security to provide strong multi-tenant resource isolation. - [Write Acknowledgement Strategies](https://awesome-repositories.com/f/data-databases/data-replication/write-acknowledgement-strategies.md) — Ensures data durability by requiring a majority of storage nodes to acknowledge a write before completion. - [Messaging Throughput Scaling](https://awesome-repositories.com/f/data-databases/horizontal-database-scaling/resource-scaling-strategies/resource-aware-scaling-controllers/messaging-throughput-scaling.md) — Dynamically adjusts resources to handle massive message volumes across millions of topics. ([source](https://github.com/apache/incubator-pulsar#readme)) - [Segmented Storage Architectures](https://awesome-repositories.com/f/data-databases/segmented-storage-architectures.md) — Splits message logs into smaller segments distributed across a cluster for independent scaling of storage and serving. ### DevOps & Infrastructure - [Message Queues](https://awesome-repositories.com/f/devops-infrastructure/message-queues.md) — Stores messages in a reliable buffer to manage event delivery between distributed components without data loss. ([source](https://github.com/apache/incubator-pulsar#readme)) ### Security & Cryptography - [Multi-Tenant Identity Management](https://awesome-repositories.com/f/security-cryptography/identity-access-management/access-control/identity-role-management/multi-tenant-identity-management.md) — Isolates user accounts and data within shared environments using authentication, authorization, and resource limits. ([source](https://github.com/apache/incubator-pulsar#readme)) - [Messaging Isolation Fabrics](https://awesome-repositories.com/f/security-cryptography/multi-tenant-isolation-layers/messaging-isolation-fabrics.md) — Enforces multi-tenant data separation and controlled stream sharing within the messaging infrastructure. ### Business & Productivity Software - [Message Data Offloading](https://awesome-repositories.com/f/business-productivity-software/storage-aggregators/cloud-storage-offloaders/message-data-offloading.md) — Moves older messaging data from high-speed local disks to remote object storage to extend retention periods. ### Software Engineering & Architecture - [Stateless Serving Layers](https://awesome-repositories.com/f/software-engineering-architecture/software-architecture/architectural-patterns/layering-presentation/layered-architectures/stateless-serving-layers.md) — Separates the stateless serving layer from the stateful storage layer to enable independent scaling of compute and disk.