Awesome GitHub RepositoriesParallel Task Orchestrators

oh-my-codex is an AI coding workflow orchestrator and a retrieval augmented generation documentation assistant. It manages complex programming tasks through a structured sequence of planning, execution, and verification phases, while providing tools for querying and translating technical documentation. The project utilizes Git worktrees to isolate parallel coding sessions, ensuring that concurrent tasks remain independent. It integrates a vector-store knowledge base to index documents into embeddings, enabling semantic search and factual context retrieval across multiple languages. The syste

Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level

Fabric is a command-line interface and framework designed to integrate artificial intelligence reasoning into shell-based workflows. It functions as an orchestration tool that connects local data pipelines to remote artificial intelligence services, allowing users to automate content analysis and complex reasoning tasks directly from the terminal. The project distinguishes itself through a modular architecture that treats prompt patterns as version-controlled, reusable logic stored on the local filesystem. By utilizing standard input and output streams, it enables users to chain these analyti

Dask es un framework de computación paralela y un programador de tareas distribuido diseñado para escalar flujos de trabajo de ciencia de datos en Python desde máquinas individuales hasta grandes clústeres. Funciona como un gestor de recursos de clúster que orquesta la lógica computacional representando las tareas y sus dependencias como grafos acíclicos dirigidos. Esta arquitectura permite al sistema automatizar la distribución de cargas de trabajo a través del hardware disponible mientras gestiona requisitos de ejecución complejos. El proyecto se distingue por un motor de evaluación perezosa que difiere las operaciones de datos hasta que se solicitan explícitamente, permitiendo la optimización global del grafo y una asignación eficiente de recursos. Incorpora el volcado de datos consciente de la memoria para evitar fallos del sistema al procesar conjuntos de datos que exceden la memoria disponible, y utiliza la fusión de grafos de tareas para combinar secuencias de operaciones en pasos de ejecución únicos, minimizando la sobrecarga de programación y la comunicación entre nodos. La plataforma proporciona una superficie de capacidades integral para el análisis de datos a gran escala, incluyendo soporte para aprendizaje automático distribuido, integración de computación de alto rendimiento y procesamiento de datos en paralelo. Ofrece herramientas extensas para la gestión del ciclo de vida del clúster, perfilado de rendimiento y monitoreo en tiempo real de la ejecución de tareas. Los usuarios pueden desplegar estos entornos en diversas infraestructuras, incluyendo hardware local, proveedores de nube, sistemas en contenedores y clústeres de computación de alto rendimiento.

GenericAgent is an LLM agent framework and autonomous system controller designed to manage local systems, web browsers, and hardware interfaces through action and observation loops. It functions as a tool orchestrator that routes model calls to local executors, enabling the automation of complex tasks on a host machine. The project is distinguished by its self-evolving AI agent capabilities, which convert successful execution paths into reusable procedural scripts and skill trees to reduce future reasoning overhead. It employs a context optimization engine that utilizes layered memory hierarc

Capistrano is a Ruby-based release manager and remote server orchestrator. It uses SSH to push code updates and execute a standardized sequence of deployment tasks across a fleet of remote machines. The tool distinguishes itself through role-based server targeting and parallel connection pooling, allowing users to assign functional labels to servers and execute commands across multiple machines simultaneously. It manages multiple environments by applying a single deployment definition across different stages through parameter-based mapping. The system provides a framework for remote task exe

Quantaxis is a quantitative trading framework designed for building, backtesting, and executing automated strategies across global equities, futures, and cryptocurrencies. It integrates an event-driven backtesting engine, a multi-market execution gateway for order routing, and a quantitative data pipeline for ingesting and storing multi-asset market data. The system features a Rust-accelerated financial library that utilizes Apache Arrow for high-performance technical indicator calculation and zero-copy data processing. It provides a containerized infrastructure model designed for orchestrati

Metaflow is a Python machine learning framework and MLOps workflow orchestrator designed to manage the lifecycle of data pipelines from local prototyping to production. It serves as a distributed compute manager and an experiment tracking system, enabling the creation of reproducible pipelines that transition between development and high-availability production environments. The framework distinguishes itself through an integrated checkpointing system that automatically persists intermediate data artifacts to remote storage, allowing failed runs to be resumed from the last successful step. It

Humanlayer is an LLM coding agent orchestrator and AI-driven workflow manager designed to coordinate multiple agents in researching, designing, and implementing features across complex codebases. It provides a multi-agent development workspace that groups AI sessions, versioned design artifacts, and worktrees into collaborative team tasks. The system features a bring-your-own-key LLM gateway to connect external AI model subscriptions and API keys. It utilizes remote AI agent daemons to run long-term coding sessions on cloud infrastructure, maintaining progress independently of the user's acti

backtesting.py is a Python trading backtesting framework used to simulate trading strategies against historical price data to evaluate performance and risk. It includes a technical trade simulator, a quantitative performance analyzer, and a financial strategy optimizer. The framework features a parallel strategy simulator that distributes execution across multiple processor cores to reduce computation time. It also provides tools for strategy parameter optimization, allowing the identification of performant settings through the use of heatmaps and metrics. The system covers trade execution m

Pixel Agents is a session manager and visualization dashboard for AI agents. It represents active agent sessions as animated pixel characters, allowing for real-time monitoring of presence, activity, and task progress within a virtual workspace. The system features a grid-based workspace editor used to design custom office layouts and import pixel art assets via manifests. It tracks agent hierarchies by visualizing sub-agents as linked characters and monitors activity through session transcript polling to trigger real-time animations. The project includes a desktop automation interface that

Machinery is a distributed task queue and asynchronous workflow engine. It provides a system for processing heavy workloads outside the main request flow using a network of distributed background workers and a message-based job orchestrator. The project manages complex task lifecycles through sequential chaining, where results are passed between tasks, and parallel coordination, which can trigger callback tasks upon the completion of a group. It supports periodic workflow scheduling for recurring jobs and delayed execution via specific timestamps. The system includes capabilities for result

Agent Squad es un framework de orquestación multi-agente basado en LLM diseñado para coordinar agentes especializados en la resolución de tareas complejas. Funciona como un sistema para gestionar equipos de agentes y supervisores, utilizando un modelo de orquestación liderado por un supervisor para descomponer problemas grandes en pasos manejables. El framework se distingue por una combinación de enrutamiento de consultas basado en intenciones y automatización con intervención humana (human-in-the-loop). Emplea un sistema de enrutamiento jerárquico para dirigir las solicitudes al agente o modelo más apropiado, mientras integra colas de mensajería asíncronas para derivar casos complejos a operadores humanos para intervención manual. El sistema cubre capacidades integrales para la gestión del estado conversacional, incluyendo memoria de múltiples niveles para mantener la coherencia en diálogos de varios turnos. También proporciona una capa de integración de herramientas que transforma el lenguaje natural en formatos estructurados para conectar agentes con APIs externas, bases de datos y bases de conocimiento. La arquitectura admite streaming de respuestas en tiempo real y modos de comunicación híbridos para manejar tanto mensajería instantánea como interacciones asíncronas.

This project is an LLM coding agent orchestrator and AI software engineering platform designed to manage fleets of agents that autonomously solve issues, handle pull requests, and fix CI failures. It functions as an agentic CI/CD automator and parallel workflow manager, coordinating the end-to-end development lifecycle from initial ticket tracking to final code merging. The system is distinguished by its modular plugin framework and isolated worktree management, which allow multiple agents to work on separate coding tasks simultaneously without file system conflicts. It utilizes role-based mo

Agent Squad is a multi-agent system orchestrator and language model agent orchestration framework. It serves as an AI workflow automation engine and tool integration layer designed to coordinate teams of specialized agents to solve complex tasks through routing, parallel execution, and state management. The project is distinguished by its ability to dynamically compose purpose-specific agents on-demand and route requests based on intent, language, or domain expertise. It supports advanced coordination patterns, including parallel subtask distribution, sequential task pipelines, and the abilit

This project is an AI agent orchestrator and local project planner designed to manage the lifecycle of software development from requirements to code. It functions as a requirement traceability tool that links product requirements and technical epics to specific tasks and commits, maintaining a complete development audit trail. The system features a GitHub issue sync manager that provides bidirectional synchronization between local project plans and remote issues. It utilizes a local-first specification engine, allowing for the brainstorming of requirements and the decomposition of technical

This project is a software development kit and framework for building AI agent orchestration, session management, and tool integration systems. It provides a backend infrastructure for hosting remote AI sessions and coordinating multi-agent workflows using large language models. The SDK enables the definition of specialized agents and the orchestration of complex tasks through parallel workstreams. It distinguishes itself by offering a multi-tenant backend capable of horizontal scaling and a headless server runtime that separates session execution from the client interface. The system covers

reconftw is an attack surface management framework and reconnaissance workflow orchestrator designed to automate the discovery, mapping, and monitoring of external digital assets. It operates as a modular tool-chain pipeline that coordinates a sequence of security tools to perform intelligence gathering and vulnerability scanning. The project distinguishes itself through a cloud-native deployment model that parallelizes scanning workloads across a fleet of remote VPS instances to bypass local resource constraints. It utilizes container-based environment isolation to ensure consistent executio

Flyte is a Kubernetes-based machine learning orchestrator and containerized pipeline manager designed for coordinating AI workflows and data pipelines. It functions as an engine for defining and executing resilient pipelines, utilizing a data lineage tracker to maintain immutable execution states and ensure reproducible outputs. The platform distinguishes itself by packaging individual tasks into separate containers to ensure dependency isolation and environment consistency. It provides specialized capabilities for machine learning, including the transformation of trained models into scalable