15 repository-uri
Modular architectures for distributing and integrating specialized skills into autonomous agent systems.
Distinguishing note: Focuses on the distribution of agent-specific capabilities rather than general plugin systems.
Explore 15 awesome GitHub repositories matching artificial intelligence & ml · Agent Plugin Frameworks. Refine with filters or upvote what's useful.
Hermes-agent is an autonomous AI agent framework and runtime designed to execute complex tasks and synthesize new skills from execution traces. It includes a provider-agnostic gateway for routing requests across multiple model backends and a serverless runtime that suspends idle agent instances and resumes them on demand across containers and virtual machines. The project provides a desktop automation toolset that controls native GUI workflows on Linux by querying accessibility APIs and injecting input events. It further distinguishes itself with the ability to generate procedural skills from
Enables runtime skill expansion by importing new toolsets without requiring system restarts or redeployment.
This project is an automated trading and agentic workflow platform designed to orchestrate complex financial tasks through state-based graphs. It provides a comprehensive framework for building, deploying, and managing autonomous agents that execute multi-step analytical processes, monitor real-time market conditions, and perform high-speed trade execution. The platform distinguishes itself through a robust agentic plugin ecosystem that integrates directly with popular AI-powered development environments and command-line interfaces. It features a specialized financial analysis engine capable
Distributes modular agent components and skills for seamless integration.
AstrBot is an orchestration framework designed for building and managing autonomous agents that integrate multimodal artificial intelligence with secure, isolated execution environments. It serves as a platform for coordinating complex agentic workflows, allowing users to connect diverse language, speech, and vision models while maintaining personalized agent personas and domain-specific knowledge bases. The platform distinguishes itself through a modular plugin architecture and a centralized visual dashboard, which together enable users to extend agent capabilities and manage operational set
Implements a modular plugin architecture for extending agent functionality with custom skills and tools.
LiveKit is a comprehensive framework for building and orchestrating real-time, multimodal AI agents that interact with users through voice, video, and text. It provides a centralized, event-driven architecture to manage the entire lifecycle of automated participants, from initialization and session state management to graceful shutdown. By utilizing a selective forwarding unit, the platform efficiently routes media streams between participants and agents, ensuring low-latency communication and secure, token-based authentication for all connections. The platform distinguishes itself through it
Customizes agent behaviors by swapping out components like text-to-speech or language models for individual tasks.
This project is a framework for developing multimodal AI agents that function as programmable participants in real-time communication rooms. It enables the construction of agents that can see, hear, and speak by integrating speech-to-text, large language models, and text-to-speech pipelines to facilitate low-latency, natural conversations. The system is distinguished by its advanced orchestration of real-time media and conversational flow, including support for full-duplex speech, preemptive response generation, and sophisticated interruption management. It further differentiates itself throu
Allows customization of synthesis or recognition plugins to modify an agent's voice or processing logic.
Valuecell is an artificial intelligence financial trading platform and market analysis engine. It functions as a multi-exchange trading bot and financial data orchestrator, designed to analyze market data and execute automated trades across global financial exchanges. The system utilizes a modular agent plugin framework that allows for the integration of third-party tools and agents through a shared community registry. It incorporates a retrieval-augmented generation approach to analyze fundamental financial documents and historical patterns, grounding AI responses in factual data. The platf
Provides a modular architecture for integrating specialized trading skills and third-party tools into the agent system.
This project is an LLM coding agent orchestrator and AI software engineering platform designed to manage fleets of agents that autonomously solve issues, handle pull requests, and fix CI failures. It functions as an agentic CI/CD automator and parallel workflow manager, coordinating the end-to-end development lifecycle from initial ticket tracking to final code merging. The system is distinguished by its modular plugin framework and isolated worktree management, which allow multiple agents to work on separate coding tasks simultaneously without file system conflicts. It utilizes role-based mo
Provides a pluggable architecture for swapping LLM models, execution runtimes, and external tool integrations.
TinyTroupe is a multi-agent simulation framework designed to create populations of persona-based agents that interact to generate synthetic behavioral data and business insights. It serves as a persona-based agent orchestrator and synthetic data generator, allowing for the definition of agents with specific personality traits and goals to coordinate their interactions through structured workflows. The project features an extensible plugin system for connecting simulated agents to external tools and servers to execute code and access remote data. It includes an agentic simulation dashboard tha
Implements an extensible architecture for connecting agents to external tools and servers for runtime skill expansion.
SerpentAI is a game AI development kit and computer vision framework designed for building autonomous agents that interact with video games. It serves as a game input automation tool and a machine learning model integration engine, allowing developers to create agents that perceive game states and execute actions. The framework utilizes a plugin-based agent architecture to provide modular extensions for game-specific logic and behaviors. It features a specialized system for training, bundling, and deploying machine learning classifiers to recognize visual contexts and game states in real time
Utilizes a modular architecture to integrate specialized behaviors and game-specific logic into agents.
Claudecodeui is an open-source web interface that orchestrates multiple AI coding agents from different providers—including Claude Code, Cursor CLI, Codex, and Gemini CLI—side by side in isolated cloud environments. It functions as a multi-provider orchestration platform, allowing users to run agents from different tools within the same workspace without being locked into a single vendor. The platform runs each agent session inside a hypervisor-level Docker sandbox that isolates filesystem, network, and process access, with sessions persisting in the cloud to survive network disconnection or
Extending the agent interface with custom tabs, backend services, and third-party integrations through a plugin system.
TaskWeaver is an LLM agent framework that interprets natural language requests and executes them as Python code, SQL queries, or shell commands. It functions as a conversational code interpreter that maintains stateful data structures across turns, generating executable code from user prompts within a session-based environment. The system is designed as a self-hosted AI agent platform that can be deployed in Docker, managing sessions and providing a web UI for data analytics and automation tasks. The framework distinguishes itself through a role-based multi-agent architecture that divides the
Extending an AI agent's capabilities by wrapping custom algorithms as reusable plugins that the agent can call during task execution.
MaiBot este un agent conversațional inteligent și un framework bazat pe plugin-uri, conceput pentru a simula o personalitate umană autentică și compania digitală. Funcționează ca un bot de mesagerie multi-platformă care conectează un agent central la diverse servicii de mesagerie instantanee printr-un sistem de adaptoare standardizat. Proiectul se distinge prin utilizarea unui sistem de memorie bazat pe grafuri de cunoștințe pentru a menține personaje consistente și profiluri de utilizator pe termen lung. De asemenea, acționează ca un orchestrator de instrumente, coordonând raționamentul multi-turn și apelurile către instrumente externe pentru a gestiona ritmul și fluxul natural al conversațiilor. Framework-ul include o arhitectură extensibilă care dispune de un model de evenimente publish-subscribe și un sistem de plugin-uri multi-proces cu capabilități de hot-reloading. Suprafața sa funcțională acoperă analiza stilului lingvistic, gestionarea expresiilor vizuale pentru activele media și un pipeline de procesare bazat pe hook-uri pentru rutarea mesajelor. Administrarea sistemului, inclusiv configurațiile modelelor și gestionarea plugin-urilor, se face printr-o interfață web centralizată.
Implements a modular architecture for integrating specialized skills via hot-reloading plugins.
This repository is a reference implementation and guided tutorial for building an AI coding agent that combines conversational interaction with file system manipulation and sandboxed shell execution. The agent uses a large language model as its core decision-making component, operating within a turn-based conversational loop where it can generate responses or invoke tools, and tool results are fed back into the dialogue. It provides primitives for reading, writing, and listing files on the local filesystem, as well as searching code using regular expressions. The agent’s capabilities are exte
Provides a modular plugin framework for registering and integrating specialized tools into autonomous agent systems.
Lucida is a multimodal AI assistant framework and containerized microservice orchestrator. It provides a platform for building agents that process and integrate speech, vision, and text inputs to perform intelligent tasks, supported by a retrieval-augmented generation system for storing and querying factual data from texts, URLs, and images. The framework features a state-graph workflow engine to route user requests through a sequence of microservices using a predefined state machine. It also includes an extensible plugin interface that allows for the integration of custom functional modules
Provides a standardized interface for integrating custom functional modules dedicated to learning and inference.
Osaurus is a local AI workflow engine and LLM agent orchestration framework designed for private execution on local hardware. It functions as a desktop application automator and a voice-controlled AI interface, enabling the development of autonomous agents that can write code, execute tools, and operate a computer without keyboard or mouse input. The system is distinguished by its ability to control native desktop applications via accessibility APIs and manage web interactions through a headless browser automation tool. It supports a local-first execution model and on-premises deployment with
Implements a modular architecture for integrating specialized skills and plugins into autonomous agent systems.