bensheldon/good_job
Good Job
Good Job is a background job processor for Ruby on Rails that utilizes a PostgreSQL database as its primary storage engine. By leveraging relational database transactions, it ensures persistent and reliable task execution, integrating directly with the Active Job framework to handle asynchronous operations and recurring job scheduling within existing application environments.
The system distinguishes itself through an in-process execution model that allows background workers to run within the same process as the web server, simplifying deployment by removing the need for separate worker services. It employs multithreaded worker execution and database-level advisory locks to coordinate tasks across distributed processes, ensuring unique execution for recurring jobs and efficient resource utilization.
The library provides comprehensive operational controls, including the ability to group related tasks into batches for collective lifecycle tracking and the use of bulk insertion to optimize high-frequency task ingestion. Administrators can manage concurrency limits, allocate dedicated thread pools for specific queues, and monitor system health through an integrated, customizable web-based dashboard.
The project includes a built-in interface for inspecting, pausing, and troubleshooting tasks in real time, alongside configurable history retention for auditing and performance analysis.
Features
- Background Job Processors - Provides a multithreaded background job backend for Ruby on Rails that uses a relational database for reliable task queuing.
- Job Queue Persistence - Uses relational database tables as the primary storage engine to ensure transactional integrity and persistence for all queued background tasks.
- Asynchronous Queue Prioritization - Enables configuration of isolated thread pools and dedicated processes to prioritize specific queues and ensure sufficient processing capacity.
- Background Job Processing - Processes asynchronous tasks using a persistent database queue and multithreaded architecture to ensure reliable execution.
- Job Concurrency Controllers - Restricts the number of simultaneous executions for specific tasks to prevent race conditions or resource exhaustion when interacting with external services.
- Database-Backed Persistence - Leverages relational database transactions to ensure reliable task completion and consistent state management.
- Ruby on Rails Integrations - Integrates directly with the Active Job framework to handle asynchronous operations within Ruby on Rails applications.
- Batch Processing Jobs - Allows grouping multiple tasks into a single collection to track collective progress and trigger lifecycle callbacks.
- Distributed Recurring Task Scheduling - Runs automated operations on a fixed timetable using standard time expressions with unique execution across distributed processes.
- Task Queue Management - Provides administrative controls to halt execution of specific task types or entire queues temporarily for maintenance purposes.
- Job Batching - Groups multiple related tasks into a single collection to track collective progress and trigger callbacks upon completion.
- Background Processing - Integrates worker execution directly into the application server runtime to simplify deployment.
- Distributed Job Locking - Prevents multiple workers from processing the same job simultaneously using database-level advisory locks.
- Bulk Enqueueing - Buffers and inserts large volumes of tasks into the database in single operations to optimize performance during high-frequency ingestion.
- Task Completion Tracking - Monitors the progress of a batch of asynchronous tasks and resolves when all are finished.
- Worker Pool Models - Runs concurrent background tasks within a single process using a thread pool model to maximize resource utilization.
- Background Job Monitoring - Provides a web-based dashboard for inspecting, managing, and troubleshooting queued or recurring tasks in real time.
- Web Dashboard Monitors - Includes a monitoring interface for inspecting, managing, and troubleshooting queued, running, or completed background tasks.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
