leahneukirchen/nq
Nq
nq is a daemonless job orchestrator and POSIX shell task manager that manages asynchronous command execution on Unix systems. It functions as a command line job queue using directories and file-system locks to coordinate background processes across multiple terminal sessions.
The system distinguishes itself by utilizing file-system-based locking to ensure sequential job execution without requiring a resident background daemon. It enables shared queue coordination, allowing different terminal sessions to synchronize work by directing tasks to specific directories.
The project covers background task monitoring and job log management, persisting output to disk for auditing and streaming live progress to the terminal. It includes capabilities for job completion synchronization, the ability to restart previously completed jobs, and integration with terminal multiplexers to decouple execution output from the primary shell.
Configuration is handled through system environment variables to define queue locations and operational behavior.
Features
- Daemonless Synchronization - Implements a daemonless orchestration system using file-system locks to synchronize sequential task execution.
- Distributed Task Coordination - Coordinates shared queues across multiple terminal sessions using file system locks to prevent concurrent execution.
- Sequential Job Runners - Ensures strict execution order by polling for the completion of a preceding task before starting the next.
- Job Queues - Implements a system for managing and tracking the sequential execution of background jobs.
- Multi-Session Coordination - Enables synchronization of work across multiple terminal sessions by directing tasks to shared directories.
- Output Streaming - Allows users to stream live output and logs from background jobs directly to the terminal.
- POSIX Shell Task Managers - Orchestrates background processes across multiple terminal sessions with persistent logging and job tracking.
- Task Queue Isolation - Provides isolation for different work streams by organizing tasks and logs into separate folder structures.
- Queue and Log Persistence - Captures standard output and error streams to disk for auditing and real-time monitoring.
- Background Job Monitoring - Tracks real-time output and progress of background processes without requiring an active terminal session.
- Background Job Queues - Functions as a background task runner that uses file-system locks to ensure sequential order on Unix systems.
- Job Execution Logging - Persists background command output to files and streams logs for debugging and auditing.
- File-Based Job Orchestrators - Provides a daemonless queue system using directories and lock files to manage asynchronous command execution.
- Terminal Workflow Automations - Automates complex sequences of shell commands and integrates with terminal multiplexers for visibility.
- Completion Synchronization - Pauses the current session until specified background jobs or all queued tasks finish executing.
- Queue Location Configuration - Isolates different task queues by directing logs and lock files to specific directories via environment variables.
- Environment Variable Configurations - Uses environment variables to define queue locations and operational behavior at runtime.
- Job Result Persistence - Provides persistence of background job execution results to files for later auditing.
