1 repo
Frameworks for distributing background work across multiple nodes to ensure reliable and scalable task processing.
Distinguishing note: Specifically addresses distributed task distribution and message handling, distinct from local execution engines.
Explore 1 awesome GitHub repository matching software engineering & architecture · Distributed Task Queues. Refine with filters or upvote what's useful.
Celery is an asynchronous job processor and distributed task queue designed to offload time-consuming operations to background worker nodes. By utilizing a message-passing architecture, it decouples task producers from consumers, allowing applications to maintain responsiveness while scaling workloads across multiple isolated environments. The system functions as a distributed workload orchestrator that manages the lifecycle of deferred operations through persistent queues. It distinguishes itself by providing a pluggable transport abstraction, which allows the core task logic to remain indep
Scales application workloads by distributing high volumes of concurrent jobs across multiple worker nodes using a message broker architecture.