5 repository-uri
Systems for integrating parallelization into machine learning development cycles.
Distinguishing note: Focuses on workflow integration, distinct from specific parallelization techniques.
Explore 5 awesome GitHub repositories matching artificial intelligence & ml · Parallel AI Workflows. Refine with filters or upvote what's useful.
ColossalAI is a distributed deep learning framework designed for training and deploying massive artificial intelligence models across clusters of hardware accelerators. It functions as a parallel computing engine that partitions model workloads and data across multiple processors to maximize memory efficiency and throughput. The platform distinguishes itself through a comprehensive suite of parallelization strategies, including multi-dimensional tensor parallelism and pipeline-based model parallelism, which segment neural network layers and stages across devices. To support large-scale genera
Implements advanced data and tensor parallelism strategies to accelerate development and deployment cycles.
CodeWhale is an AI coding agent orchestrator and development harness designed to coordinate autonomous agents that read, edit, and verify code. It provides a secure environment for AI agents to perform multi-step software engineering tasks, utilizing a sandboxed execution model to isolate shell commands and protect the host system. The system distinguishes itself by spawning multiple independent agents in parallel to handle separate investigation or implementation slices simultaneously. It employs a multi-model gateway to route requests across various cloud APIs and local servers, and utilize
Enables the simultaneous execution of multiple independent AI agents to handle separate implementation slices of a project.
This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ
Executes multiple concurrent AI coding tasks using isolated contexts to handle separate objectives.
Humanlayer is an LLM coding agent orchestrator and AI-driven workflow manager designed to coordinate multiple agents in researching, designing, and implementing features across complex codebases. It provides a multi-agent development workspace that groups AI sessions, versioned design artifacts, and worktrees into collaborative team tasks. The system features a bring-your-own-key LLM gateway to connect external AI model subscriptions and API keys. It utilizes remote AI agent daemons to run long-term coding sessions on cloud infrastructure, maintaining progress independently of the user's acti
Runs multiple AI coding sessions simultaneously using local or cloud daemons to accelerate feature delivery.
This project is an LLM coding agent orchestrator and AI software engineering platform designed to manage fleets of agents that autonomously solve issues, handle pull requests, and fix CI failures. It functions as an agentic CI/CD automator and parallel workflow manager, coordinating the end-to-end development lifecycle from initial ticket tracking to final code merging. The system is distinguished by its modular plugin framework and isolated worktree management, which allow multiple agents to work on separate coding tasks simultaneously without file system conflicts. It utilizes role-based mo
Spawns multiple AI agents to resolve separate issues simultaneously using isolated worktrees.