AutoMQ is a cloud-native streaming platform and Apache Kafka distribution that implements a decoupled compute and storage architecture. It functions as an S3-backed message queue, using object storage as the primary log repository to eliminate dependencies on local disks.
The platform utilizes a stateless broker architecture to enable dynamic compute scaling and automated partition balancing. This design allows the system to adjust the number of brokers in seconds and distribute network traffic without requiring manual data migration or partition reassignment.
The system provides multi-availability zone data replication for resilience and employs metadata-driven client routing to reduce cross-zone network traffic costs. It further integrates real-time event streams with standardized table formats to unify streaming data with analytical processing.
