rails/solid_queue
Solid Queue
Solid Queue is a background job processing system for Ruby on Rails applications that utilizes a relational database as its primary storage backend. By integrating directly with the framework's native job interface, it ensures that task queues and execution states are persisted within the database, providing reliability and recoverability across system failures.
The system distinguishes itself by embedding worker processes directly into the web server environment, which simplifies deployment and consolidates monitoring within existing infrastructure. It coordinates distributed worker processes through database-level locking and polling mechanisms, allowing for consistent job claims and execution across multiple instances.
Beyond basic task execution, the library provides tools for managing system resources through concurrency throttling, which restricts the number of simultaneous executions for specific task types. It also includes a built-in scheduler for recurring operations, allowing for the automation of periodic tasks using fixed time intervals. The system supports custom lifecycle hooks to manage resource initialization and connection cleanup during worker startup and shutdown.
Features
- Relational Database Processors - Provides a background job processing system that uses a relational database for reliable task persistence and recovery.
- Job Queues - Provides a database-backed job queue that uses relational tables to manage and execute asynchronous tasks.
- Polling-Based Worker Execution - Dispatches background tasks by having workers continuously poll the database for pending work units.
- Database-Backed Persistence - Uses relational database tables as the primary storage layer to ensure job durability and transactional integrity.
- Background Task Execution - Executes queued operations asynchronously using a relational database to ensure reliable and recoverable workloads.
- Ruby on Rails Integrations - Integrates natively with the framework's job interface to simplify background processing within web applications.
- Advisory Locking Mechanisms - Coordinates distributed worker job claims using database-level advisory locks to prevent race conditions.
- Background Worker Processes - Embeds background worker threads directly into the application server process to simplify infrastructure and share memory.
- Job Concurrency Controllers - Restricts the number of simultaneous executions for specific task types to prevent system overload.
- Persistent Job Queue Libraries - Implements a native backend for the framework's job interface, persisting task queues directly in the database.
- Web Server Process Integrations - Embeds background worker processes directly within the web server environment to simplify deployment and monitoring.
- Recurring Task Schedulers - Manages recurring task definitions and execution metadata within relational database tables for consistent scheduling.
