34 रिपॉजिटरी
Controls for restricting the number of simultaneous executions for specific processes.
Distinguishing note: Focuses on flow-level concurrency control.
Explore 34 awesome GitHub repositories matching devops & infrastructure · Execution Rate Limiters. Refine with filters or upvote what's useful.
Autoresearch is an autonomous machine learning research agent and architecture search framework. It employs a closed-loop system to programmatically rewrite training and architecture source code to discover optimal language model configurations. The system iteratively modifies code and evaluates performance metrics to improve model quality based on a target objective. It optimizes model performance and training efficiency by tracking validation bits per byte, which allows for a fair comparison of architectural changes independently of vocabulary size. The framework manages the full training
Limits each experimental training run to a specific time window to evaluate efficiency across different configurations.
Kestra is a declarative workflow orchestrator designed to manage complex task dependencies and automated processes through versioned configuration files. It functions as a distributed platform that decouples task scheduling from execution by offloading computational workloads to a fleet of worker nodes. The system uses a reactive, event-driven engine to initiate workflows automatically in response to external signals, webhooks, schedules, or file system changes. The platform distinguishes itself through a modular plugin architecture that allows for the integration of custom tasks and external
Restricts the number of simultaneous executions for a specific flow to protect downstream systems.
Ciphey is an automated decryption tool and cryptographic analysis framework designed to identify and reverse encryptions, encodings, and hashes without requiring a known key or cipher. It functions as a hash cracking engine and a heuristic cipher identifier to recover original plaintext from unknown data patterns. The project features a nested encoding resolver that iteratively unwraps multiple layers of encryption and encoding until readable text is reached. It employs a heuristic cryptanalysis workflow to analyze data characteristics and guess the likely encoding scheme or encryption method
Sets maximum time windows for decoding attempts to prevent infinite execution on undecodable text.
Activepieces is an open-source, self-hosted workflow automation platform designed to connect third-party applications through modular triggers and actions. It provides a low-code integration framework that allows users to build, manage, and execute complex business logic sequences within isolated, sandboxed environments. The platform distinguishes itself through its focus on embeddability and enterprise-grade security. It features an embedded automation builder that can be integrated into external applications via iframes, supported by comprehensive identity and access management tools such a
Restricts simultaneous flow runs to manage resource consumption and prevent system overload.
PydanticAI is a Python framework designed for building production-grade autonomous agents. It provides a unified interface for interacting with diverse language models, enabling developers to construct agents that perform complex tasks through structured data validation, tool execution, and multi-turn conversation management. The library centers on type-safe schema enforcement, ensuring that model inputs and outputs remain consistent and reliable throughout the agent's lifecycle. The framework distinguishes itself through a robust architecture that emphasizes modularity and testability. It ut
Restricts simultaneous executions and request counts to protect system resources during agent runs.
Koel is a self-hosted music streaming server designed for hosting, managing, and streaming personal digital music collections via web and mobile applications. It functions as a personal audio streaming platform that allows users to organize local and cloud-based audio libraries with integrated user accounts and playlist management. The system distinguishes itself by acting as a cloud-integrated media server, enabling the connection of remote storage providers to serve music files without requiring local disk space. It provides a cross-platform playback experience, ensuring consistent access t
Allows adjustment of PHP memory limits and execution timeouts to support large file uploads and long-running requests.
This tool is a command-line utility designed for automated web resource discovery, fuzzing, and application structure mapping. It functions as a security-focused scanner that identifies hidden files, directories, parameters, and virtual hosts by injecting payloads into HTTP requests. By systematically testing how servers handle various inputs, it assists in mapping the architecture of web applications and uncovering potential security vulnerabilities. The tool distinguishes itself through a highly concurrent engine that manages asynchronous request execution and recursive job orchestration. I
Terminates fuzzing tasks after a specified time period to manage system resource usage effectively.
Sidekiq is a background job processor and queue manager for Ruby that uses Redis to manage asynchronous tasks. It functions as a distributed task scheduler capable of handling periodic, delayed, and recurring jobs across a cluster of worker processes. The project features a job monitoring dashboard and administrative web interface for visualizing system state, tracking worker performance, and managing failed or dead jobs. It provides a distributed rate limiter to control execution frequency across multiple processes. The framework covers a broad range of operational capabilities, including j
Provides controls for restricting the number of simultaneous job executions to prevent system overload.
This project is a lightweight Python scheduling library used for managing recurring jobs and automating the execution of functions within a single process. It serves as an event-based task scheduler that triggers functions at specific intervals or weekdays. The library utilizes human-readable timing syntax to schedule periodic function calls. It supports the organization of timed workflows through job tag filtering and provides mechanisms for scheduler state inspection to track planned execution times. The system handles both periodic and specific job scheduling with timezone support. It inc
Includes capabilities to terminate scheduled tasks via timeout conditions or manual cancellation.
This project is a performance measurement framework and microbenchmarking library designed for C++ and Python. It provides a toolset for measuring the execution time of small code fragments using high-resolution timers, calculating statistical aggregates, and analyzing asymptotic complexity. The framework distinguishes itself through specialized capabilities for multithreaded performance testing, using synchronized execution to measure parallel throughput. It includes mechanisms to prevent compiler optimizations from removing benchmarked code and supports complex parameterization via Cartesia
Provides mechanisms to filter benchmarks via regular expressions or limit execution time.
Metaflow is a Python machine learning framework and MLOps workflow orchestrator designed to manage the lifecycle of data pipelines from local prototyping to production. It serves as a distributed compute manager and an experiment tracking system, enabling the creation of reproducible pipelines that transition between development and high-availability production environments. The framework distinguishes itself through an integrated checkpointing system that automatically persists intermediate data artifacts to remote storage, allowing failed runs to be resumed from the last successful step. It
Provides limits on the maximum execution time for individual pipeline tasks to prevent hanging processes.
BullMQ is a Redis-backed message queue library and background processor designed for distributed task queueing. It functions as a distributed queue manager and task scheduler, utilizing Redis to manage asynchronous job processing and persistence. The system distinguishes itself through its role as a job workflow orchestrator, enabling the definition of complex parent-child job dependencies and hierarchies for multi-step workflows. It provides sandboxed process execution to isolate heavy workloads and prevent event loop blocking, alongside distributed rate limiting to protect downstream servic
Caps the number of jobs processed over a specific time window to prevent overloading external systems.
Restricts how many times a function can fire over a set period using fixed or sliding windows.
OpenWhisk is a serverless cloud platform designed for deploying and executing stateless functions in response to API calls or events. It serves as a complete serverless stack, providing an API gateway for functions, a function-as-a-service runtime manager, and an event-driven workflow engine. The platform distinguishes itself through a polyglot execution model that supports multiple language runtimes and allows for the creation of custom runtimes using Docker containers. It enables complex logic through function orchestration and composition, allowing multiple functions to be chained into seq
Applies rate limits to the number of triggers per minute to control the volume of concurrent function executions.
Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it
Sets maximum execution duration for tasks, treating timeout as a failure for retry.
mistral.rs is an inference engine for large language models that runs locally and exposes models behind OpenAI and Anthropic-compatible APIs. It serves as a multi-model serving platform, capable of loading several models in a single server process with per-request routing and on-demand loading and unloading. The engine supports multimodal inference, processing text alongside images, video, audio, and speech inputs, and includes a quantized model deployment runtime that reduces memory use and speeds up inference on consumer hardware. The project distinguishes itself through an agentic tool exe
Limits the number of tool call rounds in the server-side loop before forcing a response.
TanStack Form is a cross-framework form state management library that provides typed fields, validation, and submission across React, Vue, Angular, Solid, Lit, Svelte, and Preact. It uses a shared form model that adapts to different UI frameworks while preserving the same validation and submission logic, and offers headless form controls that impose no UI markup, letting developers bring their own inputs and design system. The library distinguishes itself through granular state subscription, where components subscribe to narrow slices of form or field state using reactive primitives, so only
Ships a rate limiter that restricts function execution over configurable time windows.
Gevent is a Python coroutine concurrency library and asynchronous task manager designed for high-concurrency I/O tasks. It provides a cooperative networking framework for building asynchronous TCP, UDP, and HTTP servers, as well as a WSGI web server implementation for hosting web applications. The project is distinguished by its standard library monkey-patching tool, which replaces blocking synchronous functions with cooperative versions to enable asynchronous behavior in third-party code. This allows for a cooperative multitasking workflow where the system yields execution during I/O waits t
Sets maximum time durations for specific operations to interrupt code that runs longer than expected.
Open Multi-Agent is a TypeScript framework for multi-agent orchestration that decomposes natural language goals into a runtime-generated directed acyclic graph of tasks. It functions as a task orchestrator and workflow state manager, coordinating multiple AI models to execute parallel and sequential operations. The framework is distinguished by a proposer-judge consensus protocol used to validate agent outputs through a quorum of agreement. It employs provider-agnostic model routing to assign specific models to tasks based on roles or execution phases and utilizes state-based workflow checkpo
Implements wall-clock timeouts to abort agent runs and prevent system hangs.
Pytesseract is a Python library that wraps Google's Tesseract OCR engine to extract text from images. It provides a straightforward interface for optical character recognition, supporting multiple languages and a variety of output formats. The library distinguishes itself by offering fine-grained control over the OCR process through custom Tesseract configuration options, including engine mode and page segmentation settings. It can detect image orientation and script type, recognize text in multiple languages, and return detailed metadata such as per-character confidence scores and bounding b
Terminates the Tesseract process when it exceeds a set time limit.