apache/rocketmq

Features

• Distributed Messaging - Provides a scalable and fault-tolerant distributed messaging platform for asynchronous communication and event-driven architectures.
• Stream Processing - Manages high-throughput data streams with strict message ordering, delayed delivery, and historical retrieval.
• Write Acknowledgement Strategies - Requires a majority of replicas to acknowledge write operations to ensure data durability across a distributed cluster.
• CommitLog-Based Storage - Implements a sequential log file on disk to ensure high-performance writes and reliable data recovery.
• Storage-Compute Architectures - Separates stateless compute nodes from stateful storage layers to scale processing and data retention independently.
• Stream Processing Engines - Functions as a cloud-native streaming engine that decouples compute from storage for high-throughput ingestion.
• Message Queues - Provides scalable infrastructure for asynchronous task buffering and reliable event-driven workflow execution.
• Connectivity And IoT Networks - Handles high-volume messaging from mobile applications and IoT terminals using the MQTT protocol.
• MQTT Message Brokers - Provides a high-performance MQTT broker to bridge IoT device traffic into distributed data streams.
• MQTT Messaging Integrations - Bridges MQTT traffic from lightweight IoT devices into the internal high-performance data stream.
• Multi-Protocol Interoperability - Enables communication across different systems using industry-standard protocols such as gRPC, MQTT, and JMS.
• Message Ordering Guarantees - Guarantees strict first-in-first-out delivery and ordering for messages within the same queue.
• Transactional Queues - Implements a distributed transactional queue that ensures atomicity between local transactions and message delivery.
• Transactional Message Coordination - Ensures atomicity between local transactions and message delivery to maintain consistency across distributed operations.
• Distributed Task Queues - Partitions data into multiple queues across a cluster to enable parallel processing and horizontal scalability.
• Two-Phase Commit Protocols - Coordinates between a local transaction and a message send to ensure atomic delivery of messages.
• Distributed Transaction Management - Ensures data consistency across multiple services using transactional messaging to maintain atomicity for critical operations.
• Kubernetes Operators - Utilizes Kubernetes operators to automate the deployment, scaling, and failover of messaging clusters.
• Message Data Offloading - Moves data from local disks to cheaper, larger storage mediums to extend retention periods.
• Message Filtering - Enables precise message delivery using SQL expressions and metadata tags.
• External Data Connectors - Moves data reliably and scalably between the internal messaging system and external third-party platforms.
• External System Synchronization - Streams data between the platform and other systems using a set of source and sink connectors.
• Schema Registries - Provides a schema registry to manage and version data schemas for compatibility between producers and consumers.
• Storage Tiering - Moves cold data from local high-speed disks to remote object storage to extend data retention.
• Container Deployment - Ships components as isolated containers to ensure environment consistency and simplify deployment.
• Kubernetes Cluster Management - Automates the lifecycle management and node failover of messaging clusters using Kubernetes operators.
• Kubernetes Orchestration - Provides Kubernetes operators to manage the system lifecycle and custom resource definitions.
• Automated Master Failovers - Automatically detects primary node failures and promotes a secondary node to maintain continuous system availability.
• MQTT Bridging - Serves as an MQTT IoT message broker to bridge lightweight device traffic into high-performance data streams.
• Messaging Client Connections - Manages client connectivity by handling encrypted transport, authentication, and authorization.
• Multi-Protocol Translation - Converts various external communication protocols into a single internal format for unified backend processing.
• Messaging Protocol Translation - Converts incoming traffic from various protocols into a single internal format for backend storage components.
• Consumption Models - Supports both pull and push consumption models to optimize client performance.
• Message Scheduling - Schedules messages for delivery at a specific future timestamp to control when data reaches the consumer.
• Message Stream Replayers - Allows retrieval and replay of historical messages by specifying timestamps or sequence offsets.
• Polyglot Client Support - Allows clients written in different languages to interact with the system via standardized communication protocols.
• Authentication & Authorization Systems - Controls system entry using integrated identity verification and granular permission enforcement.
• Access Control List Management - Secures the system by restricting resource access through defined access control lists.
• Messaging Patterns - Implements diverse communication strategies including publish-subscribe and request-reply patterns.
• Administrative Consoles - Ships a web-based operations console for managing maintenance and operational tasks on the cluster.
• Cluster Monitoring Dashboards - Provides a centralized graphical dashboard for monitoring cluster metrics and modifying configurations.
• Distributed Tracing - Integrates distributed tracing to track the end-to-end path of messages through the system.
• Cluster Monitoring Systems - Exports real-time health and performance metrics to external observability tools.
• Multi-Language Client Generation - Automates the creation of official client libraries for multiple programming languages to support diverse environments.
• Data Pipelines - Distributed messaging and streaming platform.
• Infrastructure and Backend - Distributed messaging middleware with queue models.

Star history