8 repository-uri
Executing tasks in separate child processes to protect the main worker loop from crashes.
Distinct from Distributed Task Workers: Focuses on the mechanism of process isolation via forking rather than the distributed nature of workers.
Explore 8 awesome GitHub repositories matching devops & infrastructure · Process-Based Isolation. Refine with filters or upvote what's useful.
rq is a distributed task queue and background worker system for Python that uses a Redis backend to decouple task submission from execution. It functions as a reliable message queue and task scheduler, allowing Python functions or asyncio coroutines to be processed asynchronously across multiple worker processes. The project distinguishes itself through reliable queuing mechanisms that prevent job loss during worker crashes using atomic operations. It provides specialized orchestration capabilities, including the prevention of duplicate jobs, job execution prioritization, and the ability to m
Uses fork-based execution to isolate the worker's main loop from job crashes.
Agenda is a persistent background job scheduler and distributed task runner for Node.js applications. It functions as a cron job manager and task queue that ensures background processes survive application restarts by storing job state and metadata in a database. The system coordinates execution across multiple worker instances using distributed locking mechanisms to prevent duplicate processing. It supports flexible scheduling via cron expressions or specific dates and includes a pluggable storage interface for backends such as MongoDB, PostgreSQL, and Redis. The platform provides controls
Offloads heavy or long-running tasks to separate child processes to isolate crashes and prevent main thread blocking.
Resque is a Ruby library for enqueueing and processing asynchronous tasks using Redis as a data store. It functions as a distributed task processor and queue manager, allowing long-running work to be moved out of the main request cycle. The system executes background jobs in isolated child processes to prevent memory leaks and provides a web-based dashboard for monitoring queue depths, worker activity, and failed job statistics. Capability areas include distributed worker coordination via signals, error handling with job retry mechanisms, and priority-ordered queue management. It also suppor
Executes every background job in a separate child process to isolate crashes and prevent memory leaks.
Cog is a machine learning packaging tool and containerized model wrapper that bundles models and their dependencies into standardized Docker containers. It functions as an environment manager and inference server, ensuring consistent model execution across different hardware systems by resolving GPU drivers, system libraries, and Python dependencies. The project distinguishes itself by automatically generating RESTful HTTP servers and OpenAPI schemas based on defined model input and output types. It manages large model weights as external fixtures to optimize image size and utilizes a slot-ba
Executes predictions in separate subprocesses to prevent memory leaks or worker crashes from affecting the main process.
BullMQ is a Redis-backed message queue library and background processor designed for distributed task queueing. It functions as a distributed queue manager and task scheduler, utilizing Redis to manage asynchronous job processing and persistence. The system distinguishes itself through its role as a job workflow orchestrator, enabling the definition of complex parent-child job dependencies and hierarchies for multi-step workflows. It provides sandboxed process execution to isolate heavy workloads and prevent event loop blocking, alongside distributed rate limiting to protect downstream servic
Executes job processors in separate child processes to isolate heavy workloads and prevent event loop blocking.
AFL is a coverage-guided fuzzer and security vulnerability scanner used to identify software bugs and memory corruption by feeding programs mutated data. It functions as a binary instrumentation tool and a test case minimizer to locate crashes and isolate the smallest set of bytes causing a fault. The project distinguishes itself through its ability to operate as a parallel fuzzing orchestrator, distributing workloads across multiple CPU cores or networked machines. It utilizes dictionary-based mutation for complex file formats and performs input sensitivity analysis to identify critical sect
Runs target programs in separate child processes to isolate crashes and quickly reset state.
stairspeedtest-reborn is an asynchronous network testing engine and performance analyzer designed to benchmark proxy connectivity and speed. It functions as a diagnostic platform for measuring latency and throughput across multiple Shadowsocks and V2Ray proxy nodes, providing a web-based interface for configuration and visualization. The system optimizes proxy routing by evaluating the stability and efficiency of various network paths through automated batch testing. It utilizes a concurrent worker system that executes isolated subprocesses to ensure individual node tests do not interfere wit
Employs process-based isolation by executing proxy tests in separate subprocesses to prevent individual node crashes from affecting the system.
Thonny is an educational integrated development environment designed for beginners learning Python programming. It serves as both a Python IDE and a microcontroller firmware editor, providing a simplified user interface for writing, testing, and debugging code. The environment focuses on Python programming education through graphical code debugging. It utilizes visual tools to illustrate program execution flow and variable states, allowing users to step through code to understand how logic and data change during runtime. The tool also supports microcontroller firmware development, enabling t
Runs user code in separate system processes to ensure the main interface remains responsive.