What are the main features of apache/rocketmq?

The main features of apache/rocketmq are: Distributed Messaging, Stream Processing, Write Acknowledgement Strategies, CommitLog-Based Storage, Storage-Compute Architectures, Stream Processing Engines, Message Queues, Connectivity And IoT Networks.

Rocketmq | Awesome Repos

RocketMQ is a cloud-native distributed messaging platform and streaming engine. It functions as a distributed transactional queue that ensures atomicity between local transactions and message delivery, and serves as an MQTT IoT message broker to bridge lightweight device traffic into high-performance data streams.

The system is distinguished by a Kubernetes-native architecture that decouples compute from storage to allow independent scaling of traffic and data retention. It utilizes a tiered storage model to offload older data to remote storage and employs quorum-based replication and automated node failover to maintain high availability.

The platform provides comprehensive messaging and streaming capabilities, including strict message ordering, delayed delivery, and historical message retrieval. It supports diverse consumption models with SQL and tag filtering, and manages data consistency through transactional messaging and schema registry management.

Operational visibility is provided through a web operations console for visual cluster management, distributed message tracing, and integrated authentication and access control lists.

Features

Distributed Messaging - Provides a scalable and fault-tolerant distributed messaging platform for asynchronous communication and event-driven architectures.
Stream Processing - Manages high-throughput data streams with strict message ordering, delayed delivery, and historical retrieval.
Write Acknowledgement Strategies - Requires a majority of replicas to acknowledge write operations to ensure data durability across a distributed cluster.
CommitLog-Based Storage - Implements a sequential log file on disk to ensure high-performance writes and reliable data recovery.
Storage-Compute Architectures - Separates stateless compute nodes from stateful storage layers to scale processing and data retention independently.
Stream Processing Engines - Functions as a cloud-native streaming engine that decouples compute from storage for high-throughput ingestion.
Message Queues - Provides scalable infrastructure for asynchronous task buffering and reliable event-driven workflow execution.
Connectivity And IoT Networks - Handles high-volume messaging from mobile applications and IoT terminals using the MQTT protocol.
MQTT Message Brokers - Provides a high-performance MQTT broker to bridge IoT device traffic into distributed data streams.
MQTT Messaging Integrations - Bridges MQTT traffic from lightweight IoT devices into the internal high-performance data stream.
Multi-Protocol Interoperability - Enables communication across different systems using industry-standard protocols such as gRPC, MQTT, and JMS.
Message Ordering Guarantees - Guarantees strict first-in-first-out delivery and ordering for messages within the same queue.
Transactional Queues - Implements a distributed transactional queue that ensures atomicity between local transactions and message delivery.
Transactional Message Coordination - Ensures atomicity between local transactions and message delivery to maintain consistency across distributed operations.
Distributed Task Queues - Partitions data into multiple queues across a cluster to enable parallel processing and horizontal scalability.
Two-Phase Commit Protocols - Coordinates between a local transaction and a message send to ensure atomic delivery of messages.
Distributed Transaction Management - Ensures data consistency across multiple services using transactional messaging to maintain atomicity for critical operations.
Kubernetes Operators - Utilizes Kubernetes operators to automate the deployment, scaling, and failover of messaging clusters.
Message Data Offloading - Moves data from local disks to cheaper, larger storage mediums to extend retention periods.
Message Filtering - Enables precise message delivery using SQL expressions and metadata tags.
External Data Connectors - Moves data reliably and scalably between the internal messaging system and external third-party platforms.
External System Synchronization - Streams data between the platform and other systems using a set of source and sink connectors.
Schema Registries - Provides a schema registry to manage and version data schemas for compatibility between producers and consumers.
Storage Tiering - Moves cold data from local high-speed disks to remote object storage to extend data retention.
Container Deployment - Ships components as isolated containers to ensure environment consistency and simplify deployment.
Kubernetes Cluster Management - Automates the lifecycle management and node failover of messaging clusters using Kubernetes operators.
Kubernetes Orchestration - Provides Kubernetes operators to manage the system lifecycle and custom resource definitions.
Automated Master Failovers - Automatically detects primary node failures and promotes a secondary node to maintain continuous system availability.
MQTT Bridging - Serves as an MQTT IoT message broker to bridge lightweight device traffic into high-performance data streams.
Messaging Client Connections - Manages client connectivity by handling encrypted transport, authentication, and authorization.
Multi-Protocol Translation - Converts various external communication protocols into a single internal format for unified backend processing.
Messaging Protocol Translation - Converts incoming traffic from various protocols into a single internal format for backend storage components.
Consumption Models - Supports both pull and push consumption models to optimize client performance.
Message Scheduling - Schedules messages for delivery at a specific future timestamp to control when data reaches the consumer.
Message Stream Replayers - Allows retrieval and replay of historical messages by specifying timestamps or sequence offsets.
Polyglot Client Support - Allows clients written in different languages to interact with the system via standardized communication protocols.
Authentication & Authorization Systems - Controls system entry using integrated identity verification and granular permission enforcement.
Access Control List Management - Secures the system by restricting resource access through defined access control lists.
Messaging Patterns - Implements diverse communication strategies including publish-subscribe and request-reply patterns.
Administrative Consoles - Ships a web-based operations console for managing maintenance and operational tasks on the cluster.
Cluster Monitoring Dashboards - Provides a centralized graphical dashboard for monitoring cluster metrics and modifying configurations.
Distributed Tracing - Integrates distributed tracing to track the end-to-end path of messages through the system.
Cluster Monitoring Systems - Exports real-time health and performance metrics to external observability tools.
Multi-Language Client Generation - Automates the creation of official client libraries for multiple programming languages to support diverse environments.
Data Pipelines - Distributed messaging and streaming platform.
Messaging Systems - High-performance distributed messaging and streaming platform.
Infrastructure and Backend - Distributed messaging middleware with queue models.

nats-io/nats-server

20,076عرض على GitHub

NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

apache/incubator-rocketmq

22,461عرض على GitHub

RocketMQ is a distributed messaging and streaming platform designed for building event-driven applications. It serves as middleware to decouple services using publish-subscribe and request-reply patterns, and functions as a transactional messaging system that ensures atomicity by linking message delivery to local transaction outcomes. The platform includes specialized capabilities as a Kubernetes-native message broker for container orchestration environments and an MQTT broker for ingesting event data from mobile applications and hardware terminals. The system covers high-throughput data str

hazelcast/hazelcast

6,570عرض على GitHub

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

apache/pulsar

15,276عرض على GitHub

Apache Pulsar is a cloud-native distributed pub-sub messaging system designed for high-performance data ingestion. It functions as a geo-replicated data streamer and a multi-tenant event streaming platform, providing a serverless stream processing engine and a tiered storage messaging broker. The system distinguishes itself by separating serving layers from storage layers to allow independent scaling of compute and data retention. It features native geo-replication to synchronize messages across different geographical regions and employs a multi-layered tenant isolation model using authentica

apacherocketmq

Rocketmq

Features