1 repo
Mechanisms for temporarily storing data to manage flow control and system stability.
Distinguishing note: Focuses on disk-backed memory buffering for queues.
Explore 1 awesome GitHub repository matching data & databases · Data Buffering. Refine with filters or upvote what's useful.
NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By utilizing a decentralized topology, it eliminates single points of failure and allows for horizontal scaling across clusters. The system organizes message streams into topics and channels, effectively decoupling producers from consumers to support both streaming and job-oriented workloads. The platform distinguishes itself through a lookup-service-based discovery mechanism that enables clients to dynamically locate producers at runtime without requiring centralized coordination.
Spills message queues to disk when memory thresholds are exceeded to prevent service crashes.