# Python Asynchronous Task Queues

> Search results for `async task queue for Python background jobs` on awesome-repositories.com. 116 total matches; showing the first 50.

Explore on the web: https://awesome-repositories.com/q/async-task-queue-for-python-background-jobs

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/async-task-queue-for-python-background-jobs).**

## Results

- [caolan/async](https://awesome-repositories.com/repository/caolan-async.md) (28,150 ⭐) — Async is a JavaScript asynchronous flow library designed to manage the execution and coordination of asynchronous tasks in Node.js and the browser. It provides functional utilities to wrap, process, and orchestrate complex asynchronous workflows.

The library distinguishes itself through a comprehensive task orchestrator that handles dependency graphs to resolve circular references and manages concurrent task queues. It includes a unification bridge that allows callback-style and promise-based functions to operate within the same execution interface.

The project covers several primary capabil
- [hangfireio/hangfire](https://awesome-repositories.com/repository/hangfireio-hangfire.md) (10,015 ⭐) — Hangfire is a background job scheduler and distributed task queue for .NET applications. It serves as a job orchestration framework that offloads heavy processing to background workers using a SQL-backed processor to manage job state across multiple servers.

The framework distinguishes itself through reliable task scheduling, where job metadata and arguments are persisted in an external database to ensure tasks survive application restarts. It supports advanced orchestration patterns, including the ability to chain dependent tasks so that a child job triggers automatically upon the successful
- [apache/superset](https://awesome-repositories.com/repository/apache-superset.md) (73,451 ⭐) — Superset is a web-based business intelligence platform designed for data exploration, visualization, and interactive dashboarding. It functions as a query-driven analytics engine that connects to various SQL databases, allowing users to perform ad-hoc analysis, define virtual metrics, and build complex data visualizations through a centralized interface.

The platform distinguishes itself through a robust semantic layer that transforms raw database schemas into calculated columns and virtual metrics, enabling consistent business logic across an organization. It features a plugin-based visualiz
- [fastendpoints/fastendpoints](https://awesome-repositories.com/repository/fastendpoints-fastendpoints.md) (5,953 ⭐) — A light-weight REST API development framework for ASP.NET 8 and newer.
- [zackargyle/redux-async-queue](https://awesome-repositories.com/repository/zackargyle-redux-async-queue.md) (112 ⭐) — Async queue middleware for Redux
- [laravel/laravel](https://awesome-repositories.com/repository/laravel-laravel.md) (84,489 ⭐) — Laravel is a comprehensive full-stack web framework designed for building scalable server-side applications. It provides an integrated development environment that centers on an object-relational mapper for database abstraction, a robust routing system, and a sophisticated service container for dependency injection. The framework is built to handle complex application requirements through a modular architecture that emphasizes convention over configuration.

What distinguishes Laravel is its deep integration of background processing and event-driven communication. It features a task queue orch
- [kitstack/async-job](https://awesome-repositories.com/repository/kitstack-async-job.md) (12 ⭐) — AsyncJob is an asynchronous queue job manager with light code, clear and speed. I hope so ! 😬
- [wasp-lang/wasp](https://awesome-repositories.com/repository/wasp-lang-wasp.md) (18,146 ⭐) — Wasp is a declarative full-stack web framework that enables developers to build and deploy applications by defining their architecture in a centralized configuration. By using a high-level specification, the framework automates the orchestration of frontend, backend, and database components, ensuring that infrastructure concerns like routing, authentication, and data modeling are handled consistently across the entire stack.

The framework distinguishes itself through its compiler-driven approach, which translates declarative configurations into cohesive, production-ready codebases. It provide
- [fastapi/fastapi](https://awesome-repositories.com/repository/fastapi-fastapi.md) (99,260 ⭐) — FastAPI is a web framework for building APIs with Python. It leverages standard language type hints to provide automatic data validation, request parsing, and interactive API documentation generation. The framework supports asynchronous request handling and manages execution contexts to prevent blocking the main event loop.

The project includes a dependency injection system that allows for the resolution and injection of reusable components into request handlers. This system supports request-scoped caching, lifecycle management, and integration with security mechanisms like OAuth2 and JSON We
- [richardknop/machinery](https://awesome-repositories.com/repository/richardknop-machinery.md) (7,956 ⭐) — Machinery is a distributed task queue and asynchronous workflow engine. It provides a system for processing heavy workloads outside the main request flow using a network of distributed background workers and a message-based job orchestrator.

The project manages complex task lifecycles through sequential chaining, where results are passed between tasks, and parallel coordination, which can trigger callback tasks upon the completion of a group. It supports periodic workflow scheduling for recurring jobs and delayed execution via specific timestamps.

The system includes capabilities for result
- [goauthentik/authentik](https://awesome-repositories.com/repository/goauthentik-authentik.md) (22,035 ⭐) — Authentik is a centralized identity and access management platform designed to serve as a unified authentication authority. It enables enterprise single sign-on across diverse applications and services, providing a cloud-native identity provider that manages user sessions and security protocols from a single location.

The platform distinguishes itself through a policy-driven flow engine and a visual orchestration interface. This allows administrators to design complex, custom authentication workflows by chaining modular verification stages and conditional logic. These workflows can be further
- [capawesome-team/capacitor-background-task](https://awesome-repositories.com/repository/capawesome-team-capacitor-background-task.md) (50 ⭐) — Background Task @capawesome/capacitor-background-task Capacitor plugin for running background tasks.
- [dfed/swift-async-queue](https://awesome-repositories.com/repository/dfed-swift-async-queue.md) (276 ⭐) — A library of queues that enable sending ordered tasks to asynchronous contexts
- [agno-agi/agno](https://awesome-repositories.com/repository/agno-agi-agno.md) (40,717 ⭐) — Agno is an agent operating system designed to manage the lifecycle, tool execution, and persistent state of autonomous agents across distributed infrastructure. It provides a unified runtime environment that wraps diverse agent frameworks into a consistent, interoperable protocol, allowing developers to build and deploy complex multi-agent systems that coordinate tasks and delegate sub-processes.

The platform distinguishes itself through a robust governance and orchestration layer that includes human-in-the-loop approval gates, role-based access control, and a centralized API gateway. It feat
- [coleifer/huey](https://awesome-repositories.com/repository/coleifer-huey.md) (5,933 ⭐) — .. image:: https://media.charlesleifer.com/blog/photos/huey3-logo.png
- [lab210-dev/async-job](https://awesome-repositories.com/repository/lab210-dev-async-job.md) (12 ⭐) — AsyncJob is an asynchronous queue job manager with light code, clear and speed. I hope so ! 😬
- [resque/resque](https://awesome-repositories.com/repository/resque-resque.md) (9,480 ⭐) — Resque is a Ruby library for enqueueing and processing asynchronous tasks using Redis as a data store. It functions as a distributed task processor and queue manager, allowing long-running work to be moved out of the main request cycle.

The system executes background jobs in isolated child processes to prevent memory leaks and provides a web-based dashboard for monitoring queue depths, worker activity, and failed job statistics.

Capability areas include distributed worker coordination via signals, error handling with job retry mechanisms, and priority-ordered queue management. It also suppor
- [dragonflydb/dragonfly](https://awesome-repositories.com/repository/dragonflydb-dragonfly.md) (30,688 ⭐) — Dragonfly is a high-performance, multi-model in-memory data store designed to serve as a drop-in replacement for existing database infrastructures. By utilizing a multi-threaded, shared-nothing architecture and a fiber-based concurrency model, it maximizes CPU utilization and minimizes latency for read and write operations. The system supports a wide range of data structures, including strings, hashes, lists, sets, sorted sets, and JSON documents, while maintaining full compatibility with standard industry wire protocols and client libraries.

What distinguishes Dragonfly is its focus on effic
- [cookiecutter/cookiecutter-django](https://awesome-repositories.com/repository/cookiecutter-cookiecutter-django.md) (13,421 ⭐) — Cookiecutter Django is a command-line utility designed to generate production-ready web application structures based on the Django framework. It functions as a standardized boilerplate generator that automates the initial setup of a project, providing a consistent foundation that includes pre-configured settings, security defaults, and integrated infrastructure services.

The project distinguishes itself by providing a fully containerized development and deployment environment. It orchestrates multi-container stacks that manage databases, background workers, and web servers, ensuring that the
- [bee-queue/bee-queue](https://awesome-repositories.com/repository/bee-queue-bee-queue.md) (4,032 ⭐) — A simple, fast, robust job/task queue for Node.js, backed by Redis.
- [langchain-ai/langchain](https://awesome-repositories.com/repository/langchain-ai-langchain.md) (139,458 ⭐) — LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution.

The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing
- [cortexlabs/cortex](https://awesome-repositories.com/repository/cortexlabs-cortex.md) (8,013 ⭐) — Cortex is a Kubernetes-based machine learning infrastructure platform designed for deploying, scaling, and managing models and workloads. It functions as a serverless inference engine and GPU cluster orchestrator, providing the tools necessary to execute real-time, asynchronous, and batch model predictions.

The platform utilizes declarative infrastructure-as-code for provisioning model clusters and environments. It optimizes operational costs by elastically scaling CPU and GPU resources through the use of spot instances.

The system covers a broad set of operational capabilities, including wo
- [sczyh30/vertx-blueprint-job-queue](https://awesome-repositories.com/repository/sczyh30-vertx-blueprint-job-queue.md) (146 ⭐) — Vert.x Kue is a priority task queue developed with Vert.x and backed by Redis. It's a Vert.x implementation version of Automattic/kue.
- [encode/httpx](https://awesome-repositories.com/repository/encode-httpx.md) (15,090 ⭐) — This project is a comprehensive Python network request framework designed for both synchronous and asynchronous HTTP communication. It provides a high-performance client capable of executing non-blocking requests within event-driven applications, while also supporting standard blocking calls for simpler scripts. The library is built to operate natively across diverse asynchronous runtimes, automatically detecting and utilizing the underlying event loop for concurrency.

What distinguishes this library is its modular architecture, which decouples request construction from network execution thro
- [yaitoo/async](https://awesome-repositories.com/repository/yaitoo-async.md) (16 ⭐) — Async is an asynchronous task package for Go
- [beanstalkd/beanstalkd](https://awesome-repositories.com/repository/beanstalkd-beanstalkd.md) (6,697 ⭐) — Beanstalkd is a distributed work queue server designed for asynchronous job processing. It functions as a standalone server that distributes background tasks between producers and consumers to improve application responsiveness and throughput.

The system organizes tasks using numeric priority levels to ensure critical work is processed first. It manages the job lifecycle through discrete states and uses a simple line-based text protocol over TCP for communication.

To ensure reliability, the server persists job data to a sequential disk log, allowing the queue state to be recovered after a sy
- [joseferben/pocketbase-queue](https://awesome-repositories.com/repository/joseferben-pocketbase-queue.md) (63 ⭐) — A type-safe queue for background tasks on top of PocketBase. Works in all JavaScript environments where the PocketBase JS SDK is supported.
- [amruthpillai/reactive-resume](https://awesome-repositories.com/repository/amruthpillai-reactive-resume.md) (38,613 ⭐) — This project is a web-based platform designed for creating, managing, and sharing professional resumes. It functions as a structured document builder that integrates artificial intelligence to assist with content generation, editing, and analysis. Users can maintain a collection of resumes, customize their visual presentation through various templates, and export them into multiple formats for job applications.

The platform distinguishes itself through its autonomous AI agent capabilities, which can perform research, suggest incremental edits, and apply data patches directly to documents. It
- [pydanny/cookiecutter-django](https://awesome-repositories.com/repository/pydanny-cookiecutter-django.md) (13,539 ⭐) — cookiecutter-django is a template-based project generator and production-ready scaffold for Django web applications. It functions as a boilerplate that injects user-defined variables into predefined file templates to automate the creation of a standardized directory structure and initial project configuration.

The project provides a production blueprint that integrates a customizable user authentication system, environment-variable configuration, and a containerized development environment. It bundles Django with databases and task queues to ensure consistency across local and production work
- [tasks/tasks](https://awesome-repositories.com/repository/tasks-tasks.md) (5,344 ⭐) — Astrid was a popular cross-platform productivity service that was acquired and discontinued in 2013. The source code from Astrid's open source Android app serves as the basis of Tasks.
- [javascript-tutorial/en.javascript.info](https://awesome-repositories.com/repository/javascript-tutorial-en-javascript-info.md) (25,344 ⭐) — This project is a comprehensive JavaScript programming tutorial and language reference. It serves as a web development education resource providing instruction on modern language fundamentals, object-oriented design, and advanced asynchronous programming patterns.

The resource functions as both a frontend development guide and a technical reference. It covers core language features such as closures, prototypes, promises, and typed arrays, while providing practical lessons on managing browser data and handling network requests.

The content spans several key capability areas, including browser
- [apify/crawlee](https://awesome-repositories.com/repository/apify-crawlee.md) (24,002 ⭐) — Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture.

The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
- [bogdanp/dramatiq](https://awesome-repositories.com/repository/bogdanp-dramatiq.md) (5,136 ⭐) — Dramatiq is a distributed task queue and workload manager used to offload function execution to background workers. It functions as an asynchronous task orchestrator that enables the distribution of computational tasks across a cluster using a pluggable transport layer supporting RabbitMQ and Redis.

The framework provides specialized tools for complex task orchestration, including the ability to link background jobs into sequences, pipelines, and barriers. It further manages distributed concurrency through the use of shared mutexes, rate limiters, and exponential backoff retries to prevent re
- [billmalarky/react-native-queue](https://awesome-repositories.com/repository/billmalarky-react-native-queue.md) (798 ⭐) — A React Native Job Queue
- [async-plus/async-plus](https://awesome-repositories.com/repository/async-plus-async-plus.md) (213 ⭐) — ⛓ A chainable interface for Swift's async/await.
- [encoredev/encore](https://awesome-repositories.com/repository/encoredev-encore.md) (12,049 ⭐) — Encore is a distributed systems framework designed to unify backend development, infrastructure provisioning, and observability. It functions as an infrastructure-as-code platform that allows developers to define cloud resources, databases, and messaging topics directly within their application code. By analyzing these declarations at compile-time, the system automatically manages the deployment of cloud resources and security policies, ensuring parity between local development and production environments.

The platform distinguishes itself through its integrated development experience, which
- [techschool/simplebank](https://awesome-repositories.com/repository/techschool-simplebank.md) (6,495 ⭐) — Simplebank is a financial services backend application built with Go that manages bank accounts and transfers. It utilizes a dual-protocol interface, providing both gRPC and REST APIs via Protocol Buffers to support different client communication requirements.

The system implements a PostgreSQL data layer with versioned schema migrations and type-safe query generation. It handles financial operations through atomic fund transfers and balance change tracking to maintain consistent audit trails.

The architecture includes an asynchronous task worker system using a message queue to offload long-
- [cakephp/queue](https://awesome-repositories.com/repository/cakephp-queue.md) (36 ⭐) — This is a Queue system for CakePHP.
- [magento/magento2](https://awesome-repositories.com/repository/magento-magento2.md) (12,126 ⭐) — This project is a PHP e-commerce platform and enterprise storefront framework designed for building and managing online stores. It functions as a modular PHP application and headless commerce engine, separating e-commerce business logic from frontend presentation to support multiple storefronts and devices.

The system is built on a modular architecture that allows developers to add custom business logic and third-party integrations. It utilizes a service-contract-based API to ensure stability across module implementations and employs dependency-injection for object lifecycle management.

Core
- [flowiseai/flowise](https://awesome-repositories.com/repository/flowiseai-flowise.md) (53,641 ⭐) — Flowise is a low-code platform designed for building and deploying complex language model workflows through a visual, node-based interface. It functions as an orchestrator for autonomous multi-agent systems, allowing users to construct conversational pipelines by connecting language models, memory stores, and external tools on a drag-and-drop canvas.

The platform distinguishes itself through its support for sophisticated agentic patterns, including supervisor-worker delegation and iterative reasoning strategies. Users can design directed acyclic graphs to manage conditional branching, state p
- [lordog/dive-into-llms](https://awesome-repositories.com/repository/lordog-dive-into-llms.md) (40,974 ⭐) — Dive into LLMs is a framework designed for fine-tuning large language models and constructing modular machine learning pipelines. It provides a structured environment for adjusting pre-trained models on custom datasets while optimizing computational efficiency and training time.

The project distinguishes itself by offering an interactive web interface that allows for the deployment and publication of trained models directly to a browser. This enables users to test and interact with model results through a standardized web-based environment.

The platform supports the creation of flexible work
- [evernote/android-job](https://awesome-repositories.com/repository/evernote-android-job.md) (5,353 ⭐) — Android library to handle jobs in the background.
- [fincept-corporation/finceptterminal](https://awesome-repositories.com/repository/fincept-corporation-finceptterminal.md) (26,900 ⭐) — FinceptTerminal is a quantitative finance platform and financial engineering library designed for asset valuation, risk management, and fixed-income analytics. It provides a comprehensive suite for algorithmic trading and investment strategy automation, integrating specialized language model agents and node-based workflows to automate market research and alpha generation.

The project distinguishes itself with a dedicated game theory analysis engine for calculating Nash equilibria and simulating strategic interactions in competitive markets. It also features a specialized credit risk modeling
- [go-task/task](https://awesome-repositories.com/repository/go-task-task.md) (15,721 ⭐) — Task is a YAML-based task runner and build tool used to define and automate development workflows. It functions as a dependency-based build system and cross-platform task automator, allowing users to execute shell commands across different operating systems using a declarative configuration file.

The project operates as an incremental build tool, utilizing file fingerprints and checksums to track state and avoid redundant work by determining if tasks are up to date. It manages execution via a dependency graph to ensure prerequisites are completed before target commands run.

The system includ
- [adobe/brackets](https://awesome-repositories.com/repository/adobe-brackets.md) (33,033 ⭐) — Brackets is an extensible JavaScript IDE and front-end code editor specifically designed for authoring HTML, CSS, and JavaScript. It serves as a web development text editor that provides a specialized environment for building websites.

The editor is distinguished by its live preview capabilities, which render code changes in a browser in real time for immediate visual feedback. It further supports front-end workflows through inline style editing and the ability to synchronize code changes across multiple browser windows for cross-browser testing.

The project includes a wide range of developm
- [shopify/job-iteration](https://awesome-repositories.com/repository/shopify-job-iteration.md) (1,302 ⭐) — Makes your background jobs interruptible and resumable by design.
- [gevent/gevent](https://awesome-repositories.com/repository/gevent-gevent.md) (6,440 ⭐) — Gevent is a Python coroutine concurrency library and asynchronous task manager designed for high-concurrency I/O tasks. It provides a cooperative networking framework for building asynchronous TCP, UDP, and HTTP servers, as well as a WSGI web server implementation for hosting web applications.

The project is distinguished by its standard library monkey-patching tool, which replaces blocking synchronous functions with cooperative versions to enable asynchronous behavior in third-party code. This allows for a cooperative multitasking workflow where the system yields execution during I/O waits t
- [the-pocket/pocketflow-tutorial-codebase-knowledge](https://awesome-repositories.com/repository/the-pocket-pocketflow-tutorial-codebase-knowledge.md) (12,396 ⭐) — This project is a comprehensive suite of AI tools and frameworks, featuring an LLM multi-agent orchestrator, an autonomous agent runtime, and a stateful application framework. It provides the infrastructure to build and manage specialized AI agents capable of coordinating complex tasks through graph-based workflows and shared state.

The system is distinguished by its implementation of the Model Context Protocol, allowing for standardized resource discovery and communication between AI clients and servers. It further includes an AI-powered documentation generator designed to analyze source cod
- [async-rs/async-std](https://awesome-repositories.com/repository/async-rs-async-std.md) (4,068 ⭐) — Async version of the Rust standard library
- [rq/rq](https://awesome-repositories.com/repository/rq-rq.md) (10,653 ⭐) — rq is a distributed task queue and background worker system for Python that uses a Redis backend to decouple task submission from execution. It functions as a reliable message queue and task scheduler, allowing Python functions or asyncio coroutines to be processed asynchronously across multiple worker processes.

The project distinguishes itself through reliable queuing mechanisms that prevent job loss during worker crashes using atomic operations. It provides specialized orchestration capabilities, including the prevention of duplicate jobs, job execution prioritization, and the ability to m