1 repo
Strategies for managing throughput and backpressure in messaging systems during high load.
Distinguishing note: Focuses on dynamic flow control and backpressure rather than general network traffic shaping.
Explore 1 awesome GitHub repository matching networking & communication · Flow Control Mechanisms. Refine with filters or upvote what's useful.
NSQ is a distributed, brokerless messaging platform designed for high-throughput, fault-tolerant communication. By utilizing a decentralized topology, it eliminates single points of failure and allows for horizontal scaling across clusters. The system organizes message streams into topics and channels, effectively decoupling producers from consumers to support both streaming and job-oriented workloads. The platform distinguishes itself through a lookup-service-based discovery mechanism that enables clients to dynamically locate producers at runtime without requiring centralized coordination.
Control message flow by dynamically adjusting readiness states and implementing exponential backoff strategies to pause or resume processing during periods of high load or transient errors.