2 个仓库
Message queuing systems optimized for cloud environments using object storage for persistence.
Distinct from Message Queues: Distinct from general message queues by the specific requirement of being cloud-native and S3-backed.
Explore 2 awesome GitHub repositories matching data & databases · Cloud Native Message Queues. Refine with filters or upvote what's useful.
AutoMQ is a cloud-native streaming platform and Apache Kafka distribution that implements a decoupled compute and storage architecture. It functions as an S3-backed message queue, using object storage as the primary log repository to eliminate dependencies on local disks. The platform utilizes a stateless broker architecture to enable dynamic compute scaling and automated partition balancing. This design allows the system to adjust the number of brokers in seconds and distribute network traffic without requiring manual data migration or partition reassignment. The system provides multi-avail
Provides a Kafka-compatible streaming platform that uses object storage to remove local disk dependencies.
Jocko 是一个云原生的事件流平台和分布式提交日志,使用 Go 语言实现。它作为一个分布式消息代理,通过在集群中复制记录序列来确保数据持久性和高可用性。 该系统被设计为无需 Zookeeper 的事件流平台,利用内置的共识协调来管理集群状态和领导者选举,无需外部协调服务。它实现了 Kafka 有线协议,允许其与现有的生态系统客户端和工具进行通信。 该平台提供了分布式日志管理能力,包括使用仅追加(append-only)的提交日志进行数据持久化。它还包含自动数据保留机制,可根据时间限制或磁盘空间阈值清除旧记录。 该项目以单一二进制文件的形式发布。
Provides a lightweight messaging cluster optimized for cloud-native deployment as a single binary.