12 dépôts
Infrastructure and platforms designed to host, manage, and execute autonomous agents in remote or distributed computing environments.
Explore 12 awesome GitHub repositories matching artificial intelligence & ml · Agent Deployment Frameworks. Refine with filters or upvote what's useful.
Hermes-agent is an autonomous AI agent framework and runtime designed to execute complex tasks and synthesize new skills from execution traces. It includes a provider-agnostic gateway for routing requests across multiple model backends and a serverless runtime that suspends idle agent instances and resumes them on demand across containers and virtual machines. The project provides a desktop automation toolset that controls native GUI workflows on Linux by querying accessibility APIs and injecting input events. It further distinguishes itself with the ability to generate procedural skills from
Supports running the agent environment on external servers or containerized backends for persistent execution.
OpenHands is an autonomous agent framework designed for software engineering workflows. It provides a modular platform for orchestrating AI agents that reason, plan, and execute tasks within isolated, containerized development environments. By integrating with standard version control and development tools, the system enables agents to autonomously navigate codebases, implement features, and resolve issues through iterative reasoning and tool execution. The platform distinguishes itself through a model-agnostic orchestrator that connects diverse language models to a unified tool registry. It
Deploys agent software as containerized backend services to manage isolated workspaces and stream real-time events to clients.
Phidata is an LLM agent framework and agentic workflow orchestrator used to build autonomous agents that integrate custom data, tools, and memory. It provides a production environment for serving these agents as services via APIs, utilizing server-sent events and websockets for real-time communication. The system distinguishes itself through a human-in-the-loop control layer that requires manual approval and administrative sign-off for specific tool executions. It also implements a multi-tenant AI infrastructure that uses token-based roles to ensure data isolation between different tenants.
Provides a production environment for hosting and managing autonomous agents with integrated tracing and access controls.
Letta is a framework for building, deploying, and managing autonomous AI agents that maintain persistent state across long-term interactions. It provides a comprehensive suite of primitives for defining agents with configurable personas, modular memory blocks, and tool-use capabilities, enabling them to retain user preferences and conversation history over extended sessions. The platform distinguishes itself through its advanced memory management and orchestration capabilities. It allows agents to autonomously update their own memory, perform retrieval-augmented generation, and coordinate com
Decouples agent interaction from execution to support remote cloud-based agent operation.
Eliza is a modular framework designed for building and deploying autonomous agents that operate across diverse digital environments. It functions as an orchestrator for intelligent software, enabling agents to manage tasks, maintain persistent memory, and execute automated processes through a centralized runtime. The framework distinguishes itself through a plugin-based architecture that facilitates cross-platform social automation and blockchain transaction capabilities. By utilizing state-machine logic for decision-making and vector-based memory for context retention, the system allows agen
Provides infrastructure for hosting and executing autonomous agents in diverse environments.
This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ
Hosts agent processes on remote machines via SSH or tunnels to utilize external compute resources.
Humanlayer is an LLM coding agent orchestrator and AI-driven workflow manager designed to coordinate multiple agents in researching, designing, and implementing features across complex codebases. It provides a multi-agent development workspace that groups AI sessions, versioned design artifacts, and worktrees into collaborative team tasks. The system features a bring-your-own-key LLM gateway to connect external AI model subscriptions and API keys. It utilizes remote AI agent daemons to run long-term coding sessions on cloud infrastructure, maintaining progress independently of the user's acti
Deploys agent sessions to cloud infrastructure to ensure progress on long-running tasks persists when local machines are offline.
mcp-agent is a framework for building AI agents that integrate with Model Context Protocol servers to execute tools and access data. It functions as a multi-agent orchestrator and protocol-compliant server, enabling the creation of agents that can discover and invoke tools from connected external servers. The project distinguishes itself through a durable workflow engine that supports long-running tasks capable of pausing, resuming, and surviving restarts. It implements complex orchestration patterns, including iterative evaluator-optimizer loops, hierarchical workflow nesting, and specialist
Deploys containerized agents to remote cloud infrastructure to make capabilities available over a network.
Universe is a training and evaluation platform that transforms websites, games, and software into standardized environments for general intelligence agents. It functions as a reinforcement learning wrapper and remote environment orchestrator, providing a consistent interface to wrap diverse software for AI agent interaction. The platform distinguishes itself through a visual observation interface that streams real-time pixel data and transmits keyboard and mouse events to simulate human interaction. It utilizes a bi-directional communication protocol to deliver reward signals and performance
Launches isolated environment instances using containers or cloud clusters to provide a consistent interface for agents.
ZenML is an extensible machine learning orchestration framework designed to manage the end-to-end lifecycle of data pipelines and AI agent workflows. It functions as a durable orchestrator that executes machine learning tasks as directed acyclic graphs, ensuring that every step is containerized for consistent performance across local, cloud, and hybrid infrastructure. By decoupling pipeline code from underlying compute and storage backends, the platform allows developers to define infrastructure-agnostic stacks that remain portable across diverse environments. The project distinguishes itself
Dispatches agent code to cloud compute backends using temporary credentials, allowing local code to run on scalable infrastructure with persistent state.
AIOS is an LLM agent operating system and orchestration kernel designed to manage memory, resource scheduling, and tool execution for multiple autonomous AI agents. It serves as a comprehensive framework for developing and deploying agents, featuring a dedicated resource manager that coordinates model backends, GPU memory, and isolated kernel instances. The system distinguishes itself through a semantic memory engine that uses vector search and autonomous clustering for long-term knowledge management, and a semantic file system that allows users to control computer files and system operations
Executes agents on remote machines to offload computation from resource-restricted local hardware.
Akka.NET is an actor model framework used for building concurrent and distributed applications. It functions as a distributed computing platform and state manager that enables isolated actors to communicate via asynchronous message passing, ensuring thread-safe state management without manual locks. The project is distinguished by its decentralized coordination capabilities, including a distributed state manager that uses sharding and dynamic rebalancing to maintain high availability. It incorporates an event sourcing engine that persists state as a sequence of events in an append-only log an
Creates actor instances on remote systems across a network using configurable deployment strategies.