# Postgres Backed Task Queues

> Search results for `durable task queue backed by Postgres` on awesome-repositories.com. 119 total matches; showing the first 50.

Explore on the web: https://awesome-repositories.com/q/durable-task-queue-backed-by-postgres

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/durable-task-queue-backed-by-postgres).**

## Results

- [laravel/laravel](https://awesome-repositories.com/repository/laravel-laravel.md) (84,489 ⭐) — Laravel is a comprehensive full-stack web framework designed for building scalable server-side applications. It provides an integrated development environment that centers on an object-relational mapper for database abstraction, a robust routing system, and a sophisticated service container for dependency injection. The framework is built to handle complex application requirements through a modular architecture that emphasizes convention over configuration.

What distinguishes Laravel is its deep integration of background processing and event-driven communication. It features a task queue orch
- [redis/go-redis](https://awesome-repositories.com/repository/redis-go-redis.md) (22,159 ⭐) — This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications.

The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
- [dhamaniasad/awesome-postgres](https://awesome-repositories.com/repository/dhamaniasad-awesome-postgres.md) (11,955 ⭐) — This project is a curated directory of software, libraries, and resources designed to support the management, monitoring, and deployment of PostgreSQL database environments. It functions as a structured index of community-supported tools, providing a centralized location for users to discover utilities that enhance database functionality and reliability.

The directory organizes disparate database solutions into a logical hierarchy, covering areas such as graphical interfaces, backup and recovery utilities, and performance monitoring platforms. By categorizing these resources, it assists in th
- [factual/durable-queue](https://awesome-repositories.com/repository/factual-durable-queue.md) (407 ⭐) — a disk-backed queue for clojure
- [conductor-oss/conductor](https://awesome-repositories.com/repository/conductor-oss-conductor.md) (31,962 ⭐) — Conductor is a durable workflow engine designed to orchestrate complex, long-running business processes and autonomous agent loops. It functions as a stateful execution platform that persists the entire history of a process, ensuring that workflows remain reliable and recoverable across infrastructure failures, system restarts, and transient network errors. By managing task lifecycles, worker polling, and state transitions, it provides a centralized coordination layer for distributed systems.

The platform distinguishes itself through its specialized support for AI agent orchestration, allowin
- [bee-queue/bee-queue](https://awesome-repositories.com/repository/bee-queue-bee-queue.md) (4,032 ⭐) — A simple, fast, robust job/task queue for Node.js, backed by Redis.
- [kahun/awesome-sysadmin](https://awesome-repositories.com/repository/kahun-awesome-sysadmin.md) (24,232 ⭐)
- [laravel/horizon](https://awesome-repositories.com/repository/laravel-horizon.md) (4,168 ⭐) — Horizon is a background job orchestrator and worker manager for Redis queues. It provides a monitoring dashboard to track job throughput, wait times, and failure rates, alongside a system for managing job retries, execution timeouts, and worker distribution.

The project distinguishes itself through a Redis-backed monitoring interface that identifies system bottlenecks and a queue alerting system that sends notifications when background job wait times exceed defined thresholds. Worker processes are managed via version-controlled configuration files to ensure consistent balancing and scaling ac
- [microsoft/pg_durable](https://awesome-repositories.com/repository/microsoft-pg-durable.md) (2,002 ⭐) — PostgreSQL in-database durable execution
- [flowiseai/flowise](https://awesome-repositories.com/repository/flowiseai-flowise.md) (53,641 ⭐) — Flowise is a low-code platform designed for building and deploying complex language model workflows through a visual, node-based interface. It functions as an orchestrator for autonomous multi-agent systems, allowing users to construct conversational pipelines by connecting language models, memory stores, and external tools on a drag-and-drop canvas.

The platform distinguishes itself through its support for sophisticated agentic patterns, including supervisor-worker delegation and iterative reasoning strategies. Users can design directed acyclic graphs to manage conditional branching, state p
- [pycaret/pycaret](https://awesome-repositories.com/repository/pycaret-pycaret.md) (9,811 ⭐) — PyCaret is a Python AutoML platform and MLOps lifecycle manager designed to automate machine learning workflows. It functions as a low-code environment that leverages a scikit-learn native engine to execute preprocessing, training, and evaluation for tabular data.

The platform distinguishes itself as an LLM-powered ML copilot, using large language model agents to analyze datasets, design experiment configurations, and explain model results. It also serves as a Kubernetes ML orchestrator and model registry, enabling the versioning of trained pipelines and their promotion to production API endp
- [postgres/postgres](https://awesome-repositories.com/repository/postgres-postgres.md) (20,076 ⭐) — PostgreSQL is an object-relational database management system designed for the persistent storage and retrieval of structured information. It functions as an ACID-compliant database server, utilizing standard query language protocols to maintain data consistency and reliability across large-scale application datasets.

The system distinguishes itself through an extensible architecture that allows for the definition of custom data types, operators, and indexing methods. It employs multi-version concurrency control to enable simultaneous read and write operations without blocking, supported by a
- [activepieces/activepieces](https://awesome-repositories.com/repository/activepieces-activepieces.md) (20,887 ⭐) — Activepieces is an open-source, self-hosted workflow automation platform designed to connect third-party applications through modular triggers and actions. It provides a low-code integration framework that allows users to build, manage, and execute complex business logic sequences within isolated, sandboxed environments.

The platform distinguishes itself through its focus on embeddability and enterprise-grade security. It features an embedded automation builder that can be integrated into external applications via iframes, supported by comprehensive identity and access management tools such a
- [fastendpoints/fastendpoints](https://awesome-repositories.com/repository/fastendpoints-fastendpoints.md) (5,953 ⭐) — A light-weight REST API development framework for ASP.NET 8 and newer.
- [tasks/tasks](https://awesome-repositories.com/repository/tasks-tasks.md) (5,344 ⭐) — Astrid was a popular cross-platform productivity service that was acquired and discontinued in 2013. The source code from Astrid's open source Android app serves as the basis of Tasks.
- [rq/rq](https://awesome-repositories.com/repository/rq-rq.md) (10,653 ⭐) — rq is a distributed task queue and background worker system for Python that uses a Redis backend to decouple task submission from execution. It functions as a reliable message queue and task scheduler, allowing Python functions or asyncio coroutines to be processed asynchronously across multiple worker processes.

The project distinguishes itself through reliable queuing mechanisms that prevent job loss during worker crashes using atomic operations. It provides specialized orchestration capabilities, including the prevention of duplicate jobs, job execution prioritization, and the ability to m
- [avelino/awesome-go](https://awesome-repositories.com/repository/avelino-awesome-go.md) (175,576 ⭐) — This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains.

The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing,
- [go-task/task](https://awesome-repositories.com/repository/go-task-task.md) (15,721 ⭐) — Task is a YAML-based task runner and build tool used to define and automate development workflows. It functions as a dependency-based build system and cross-platform task automator, allowing users to execute shell commands across different operating systems using a declarative configuration file.

The project operates as an incremental build tool, utilizing file fingerprints and checksums to track state and avoid redundant work by determining if tasks are up to date. It manages execution via a dependency graph to ensure prerequisites are completed before target commands run.

The system includ
- [cakephp/queue](https://awesome-repositories.com/repository/cakephp-queue.md) (36 ⭐) — This is a Queue system for CakePHP.
- [oban-bg/oban](https://awesome-repositories.com/repository/oban-bg-oban.md) (3,812 ⭐) — Oban is a distributed background job processing system and task scheduler that uses PostgreSQL for transactional job storage and reliable execution across multiple nodes. It serves as a PostgreSQL-backed background worker and job queue, coordinating task execution and concurrency through a relational database to ensure delivery guarantees.

The system differentiates itself through a distributed workflow orchestrator capable of managing multi-step processing pipelines, dependent job sequencing, and shared context. It provides advanced orchestration tools including job batching, chunked processi
- [clickhouse/clickhouse](https://awesome-repositories.com/repository/clickhouse-clickhouse.md) (48,229 ⭐) — ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring.

The platform distinguishes itself through ad
- [sczyh30/vertx-blueprint-job-queue](https://awesome-repositories.com/repository/sczyh30-vertx-blueprint-job-queue.md) (146 ⭐) — Vert.x Kue is a priority task queue developed with Vert.x and backed by Redis. It's a Vert.x implementation version of Automattic/kue.
- [apify/crawlee](https://awesome-repositories.com/repository/apify-crawlee.md) (24,002 ⭐) — Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture.

The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
- [deuxfleurs-org/garage](https://awesome-repositories.com/repository/deuxfleurs-org-garage.md) (2,944 ⭐) — Garage is a distributed object storage system that provides an S3-compatible API gateway. It is designed to synchronize metadata across distributed nodes using conflict-free replicated data types and Merkle-tree state alignment to maintain cluster-wide consistency.

The system ensures data resilience through zone-aware replication, distributing data copies across multiple physical locations. It employs quorum-based request routing and versioned layout management to validate and commit cluster configuration changes.

The project covers a broad range of operational capabilities, including automa
- [adrianbrad/queue](https://awesome-repositories.com/repository/adrianbrad-queue.md) (357 ⭐) — ⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.
- [archivebox/archivebox](https://awesome-repositories.com/repository/archivebox-archivebox.md) (26,876 ⭐) — ArchiveBox is a self-hosted archiving tool designed for personal digital preservation and research data management. It functions as an automated web preservation engine that monitors URL inputs from bookmarks, browser history, or manual entries to capture and store permanent, offline copies of web content. By utilizing headless browser automation, the system renders dynamic web pages to ensure that captured snapshots, PDFs, and media assets remain accurate and accessible even if the original source disappears.

The project distinguishes itself through a modular extractor pipeline and a task-qu
- [encoredev/encore](https://awesome-repositories.com/repository/encoredev-encore.md) (12,049 ⭐) — Encore is a distributed systems framework designed to unify backend development, infrastructure provisioning, and observability. It functions as an infrastructure-as-code platform that allows developers to define cloud resources, databases, and messaging topics directly within their application code. By analyzing these declarations at compile-time, the system automatically manages the deployment of cloud resources and security policies, ensuring parity between local development and production environments.

The platform distinguishes itself through its integrated development experience, which
- [drizzle-team/drizzle-orm](https://awesome-repositories.com/repository/drizzle-team-drizzle-orm.md) (34,835 ⭐) — Drizzle ORM is a TypeScript-native database toolkit providing type-safe SQL query building, schema management, and automated migrations across PostgreSQL, MySQL, SQLite, and SingleStore.
- [bogdanp/dramatiq](https://awesome-repositories.com/repository/bogdanp-dramatiq.md) (5,136 ⭐) — Dramatiq is a distributed task queue and workload manager used to offload function execution to background workers. It functions as an asynchronous task orchestrator that enables the distribution of computational tasks across a cluster using a pluggable transport layer supporting RabbitMQ and Redis.

The framework provides specialized tools for complex task orchestration, including the ability to link background jobs into sequences, pipelines, and barriers. It further manages distributed concurrency through the use of shared mutexes, rate limiters, and exponential backoff retries to prevent re
- [seamapi/ava-postgres](https://awesome-repositories.com/repository/seamapi-ava-postgres.md) (5 ⭐) — ava-postgres is a test fixture for AVA that provides you with nearly-instant access to a fresh Postgres database for every test.
- [joseferben/pocketbase-queue](https://awesome-repositories.com/repository/joseferben-pocketbase-queue.md) (63 ⭐) — A type-safe queue for background tasks on top of PocketBase. Works in all JavaScript environments where the PocketBase JS SDK is supported.
- [cube-js/cube](https://awesome-repositories.com/repository/cube-js-cube.md) (20,251 ⭐) — Cube is a semantic data layer that provides a unified framework for defining business metrics, dimensions, and relationships across diverse data sources. By acting as a headless business intelligence engine, it transforms raw data into a governed model that can be queried via SQL, REST, and GraphQL interfaces. This architecture ensures consistent data definitions and logic across all downstream analytical applications and reporting tools.

The platform distinguishes itself through its integrated conversational AI capabilities, which allow users to explore data using natural language. It orches
- [temporalio/temporal](https://awesome-repositories.com/repository/temporalio-temporal.md) (18,411 ⭐) — Temporal is a distributed workflow orchestration engine designed to manage fault-tolerant, stateful, and long-running background processes. It functions as a platform for coordinating complex cross-service operations, ensuring consistency and reliability in distributed environments by decoupling workflow orchestration from task execution.

The platform distinguishes itself through a deterministic, event-sourced execution model that reconstructs workflow state by re-executing code from an immutable event log. This approach isolates non-deterministic side effects into managed activities, allowin
- [gocolly/colly](https://awesome-repositories.com/repository/gocolly-colly.md) (25,101 ⭐) — Colly is a high-performance web scraping framework designed for the automated extraction of structured data from websites. It provides a programmable toolkit that manages the complexities of large-scale data collection, including concurrent request orchestration, automatic cookie handling, and robots.txt compliance. By utilizing an asynchronous execution model, the engine maintains high throughput while preventing resource exhaustion during recursive or distributed crawling tasks.

The framework is distinguished by its modular, event-driven architecture, which allows developers to hook into sp
- [richardknop/machinery](https://awesome-repositories.com/repository/richardknop-machinery.md) (7,956 ⭐) — Machinery is a distributed task queue and asynchronous workflow engine. It provides a system for processing heavy workloads outside the main request flow using a network of distributed background workers and a message-based job orchestrator.

The project manages complex task lifecycles through sequential chaining, where results are passed between tasks, and parallel coordination, which can trigger callback tasks upon the completion of a group. It supports periodic workflow scheduling for recurring jobs and delayed execution via specific timestamps.

The system includes capabilities for result
- [dfed/swift-async-queue](https://awesome-repositories.com/repository/dfed-swift-async-queue.md) (276 ⭐) — A library of queues that enable sending ordered tasks to asynchronous contexts
- [azurewang/lua-resty-postgres](https://awesome-repositories.com/repository/azurewang-lua-resty-postgres.md) (65 ⭐) — lua-resty-postgres
- [cockroachdb/cockroach](https://awesome-repositories.com/repository/cockroachdb-cockroach.md) (32,207 ⭐) — Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures.

The system distinguishes itself through
- [voltagent/awesome-claude-code-subagents](https://awesome-repositories.com/repository/voltagent-awesome-claude-code-subagents.md) (21,906 ⭐) — This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability.

The framework distinguishes itself through its hierarchical agent registry and policy-driven
- [paperless-ngx/paperless-ngx](https://awesome-repositories.com/repository/paperless-ngx-paperless-ngx.md) (42,172 ⭐) — Paperless-ngx is a self-hosted document management server designed to transform physical paperwork into a searchable, organized digital archive. It functions as a private platform for storing, indexing, and retrieving documents, providing users with full control over their data on local infrastructure or private cloud servers.

The system distinguishes itself through an automated workflow engine that categorizes, tags, and routes incoming files using content analysis and metadata extraction. To maintain responsiveness during resource-intensive tasks like optical character recognition, it utili
- [gevent/gevent](https://awesome-repositories.com/repository/gevent-gevent.md) (6,440 ⭐) — Gevent is a Python coroutine concurrency library and asynchronous task manager designed for high-concurrency I/O tasks. It provides a cooperative networking framework for building asynchronous TCP, UDP, and HTTP servers, as well as a WSGI web server implementation for hosting web applications.

The project is distinguished by its standard library monkey-patching tool, which replaces blocking synchronous functions with cooperative versions to enable asynchronous behavior in third-party code. This allows for a cooperative multitasking workflow where the system yields execution during I/O waits t
- [jmcarp/sqlalchemy-postgres-copy](https://awesome-repositories.com/repository/jmcarp-sqlalchemy-postgres-copy.md) (59 ⭐) — sqlalchemy-postgres-copy
- [diamondio/better-queue](https://awesome-repositories.com/repository/diamondio-better-queue.md) (549 ⭐) — Better Queue for NodeJS
- [langchain-ai/langchainjs](https://awesome-repositories.com/repository/langchain-ai-langchainjs.md) (17,818 ⭐) — LangChain.js is a framework for building, executing, and monitoring stateful agentic applications. It provides an orchestration engine that models workflows as directed graphs, allowing developers to connect language models, data sources, and external tools into modular, multi-step processes.

The platform distinguishes itself through its focus on stateful execution and human-in-the-loop control. It manages agent lifecycles by persisting execution state across threads, enabling fault tolerance and the ability to pause workflows at designated breakpoints for manual review or modification. This
- [pandownloadserver/server](https://awesome-repositories.com/repository/pandownloadserver-server.md) (8,163 ⭐) — This project is a remote file transfer server and asynchronous download orchestrator. It functions as a backend service that manages a queue of remote file transfer requests to coordinate the download of files from the web to a remote storage destination.

The system operates as a distributed download coordinator, scheduling and tracking the progress of file transfers across different network nodes. It routes data requests from a client to a remote file system and utilizes asynchronous task execution to process heavy file operations in the background.

The server includes capabilities for queu
- [crunchydata/postgres-operator](https://awesome-repositories.com/repository/crunchydata-postgres-operator.md) (4,423 ⭐) — Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
- [kedacore/keda](https://awesome-repositories.com/repository/kedacore-keda.md) (10,314 ⭐) — KEDA is a Kubernetes event-driven autoscaler and cloud event scaling engine. It functions as a custom metrics provider that monitors external event sources—including message brokers, databases, and cloud metrics—to dynamically adjust the replica counts of containerized workloads.

The project is distinguished by its scale-to-zero workflow, which reduces workloads to zero replicas during inactivity and automatically restarts them when new events are detected. It operates as a multi-cloud event trigger system, using a pluggable scaler interface to integrate with a wide array of third-party servi
- [junkfood02/seal](https://awesome-repositories.com/repository/junkfood02-seal.md) (26,953 ⭐) — Seal is a mobile application designed to retrieve video and audio content from various online platforms. It functions as a graphical interface that manages background transfer processes, allowing users to download and archive media files directly to their local device storage for offline access.

The application distinguishes itself by acting as a bridge to powerful command-line utilities, orchestrating these external binaries to handle complex media extraction and file conversion tasks. Users can customize their experience through a declarative template system that defines specific execution
- [microsoft/ufo](https://awesome-repositories.com/repository/microsoft-ufo.md) (9,017 ⭐) — UFO is a multi-device task orchestrator and LLM agent orchestration framework designed to decompose natural language requests into executable task graphs. It functions as a cross-platform UI automation tool capable of performing interactions on Windows and mobile devices while routing tasks to distributed agents based on their hardware and software capabilities.

The system is distinguished by its RAG-enhanced agent architecture, which integrates external documentation and previous execution traces to improve decision-making. It employs a hybrid UI detection approach that combines computer vis
- [madflojo/tasks](https://awesome-repositories.com/repository/madflojo-tasks.md) (330 ⭐) — Package tasks is an easy to use in-process scheduler for recurring tasks in Go