piscinajs/piscina
Piscina
Piscina is a Node.js worker thread pool that runs CPU-intensive JavaScript functions across multiple threads for parallel execution. It manages a dynamic pool of worker threads with configurable size, handling task submission, cancellation, and lifecycle management through a promise-based interface.
The pool supports AbortController-based task cancellation, enabling clean termination of submitted or running tasks without disrupting other work. It enforces per-worker memory limits through V8 resource caps and applies backpressure with a configurable maximum queue size that emits a drain event when capacity becomes available. Piscina allows pluggable queue ordering to replace the default FIFO behavior with custom priority or deadline logic, and supports pluggable load balancing algorithms for assigning tasks to workers. Transferable objects like binary buffers can be passed between threads with zero-copy messaging, reducing memory overhead during data transfer.
Additional capabilities include deferred worker readiness through an asynchronous initialization protocol, performance monitoring with run-time and wait-time histograms, thread priority control on Linux, and the ability to customize worker environment setup with native addon loading. Piscina exposes a straightforward API for submitting functions to workers and retrieving results, with documentation and install instructions available through its npm package.
Features
- Local Worker Pools - Provides a configurable thread pool for parallel execution of CPU-intensive JavaScript functions.
- AbortController-Based Cancellations - Ships AbortController-based cancellation that cleanly terminates tasks without disrupting other workers.
- Custom Parallel Task Execution - Runs CPU-intensive tasks concurrently across multiple threads to improve throughput.
- Task Lifecycle Management - Manages the full lifecycle of tasks from submission through cancellation and completion in a worker pool.
- Worker Pool Management - Manages a dynamic pool of worker threads with configurable size for balancing throughput and resource usage.
- Inter-Thread Data Transfers - Supports zero-copy transfer of binary buffers and transferable objects between worker threads.
- Node.js Worker Thread Pools - Provides a Node.js worker thread pool for parallel execution of CPU-intensive JavaScript functions.
- Task Execution Engines - Runs user-defined functions on worker threads with configurable pool sizes and custom queues.
- Parallel Task Executors - Executes user-defined functions on separate worker threads with promise-based results.
- Inter-Thread Communication - Provides zero-copy transfer of binary buffers between worker threads and the main process.
- Backpressure Controllers - Limits queued tasks with a configurable maximum size and emits a drain event when capacity becomes available.
- Backpressure Queues - Implements configurable queue size limits with a drain event for backpressure control.
- Pluggable Ordering - Supports pluggable queue ordering to replace default FIFO with custom priority or deadline logic.
- Worker Initialization Scripts - Provides a deferred worker readiness protocol that runs initialization tasks before accepting new work.
- Custom Load Balancers - Allows replacing the built-in load balancing algorithm with a custom strategy for assigning tasks to workers.
- Resource Limit Enforcements - Enforces per-worker heap memory limits using V8 resource caps to prevent memory exhaustion.
- V8 Resource Caps - Enforces per-worker memory limits through V8 resource caps to prevent memory exhaustion.
- Remote Task Cancellation - Supports abort-signal-based cancellation of submitted or running tasks in the worker pool.
