Awesome GitHub RepositoriesAgent Gateways

LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc

Agno is an agent operating system designed to manage the lifecycle, tool execution, and persistent state of autonomous agents across distributed infrastructure. It provides a unified runtime environment that wraps diverse agent frameworks into a consistent, interoperable protocol, allowing developers to build and deploy complex multi-agent systems that coordinate tasks and delegate sub-processes. The platform distinguishes itself through a robust governance and orchestration layer that includes human-in-the-loop approval gates, role-based access control, and a centralized API gateway. It feat

Notifire is a multi-channel notification infrastructure designed to route and dispatch alerts across email, SMS, push, and chat providers through a unified interface. It functions as an agent communication gateway that normalizes inbound and outbound messages between chat platforms and AI agents for consistent data processing. The system includes a notification workflow engine that uses branching conditions and batching capabilities to design delivery sequences and reduce user fatigue. It also provides a pre-built notification center component, allowing web applications to embed a real-time i

Vercel is a cloud platform for building, deploying, and scaling web applications. It provides a unified infrastructure that automates the build process by detecting project frameworks and distributing static and dynamic content through a global content delivery network. The platform executes application logic using serverless functions that scale automatically based on real-time traffic demand. The platform distinguishes itself through a centralized AI gateway that proxies requests to multiple model providers, enabling standardized authentication, observability, and cost tracking. It supports

OpenHarness is a framework for building and orchestrating AI agents that utilize tools and plugins to execute complex tasks. It provides an orchestration system for managing language model lifecycles and a multi-agent coordination system for delegating workloads across teams of specialized subagents. The project features an agent gateway that bridges language model agents to external chat platforms and communication channels. It includes a tool integration engine for executing shell, file, and web operations, supported by a memory and skill manager that handles persistent user preferences and

OpenShell este un framework de securitate și un runtime de execuție sandbox pentru agenți AI autonomi. Oferă medii izolate folosind containere și mașini virtuale pentru a proteja infrastructura gazdă și datele sensibile de accesul neautorizat în timpul execuției agentului. Sistemul se distinge prin combinarea passthrough-ului accelerat hardware pentru accesul GPU al gazdei cu un gateway de securitate care interceptează apelurile API ale modelului. Acest gateway gestionează credențialele prin eliminarea informațiilor apelantului și injectarea secretelor backend, asigurându-se că cheile API sensibile rămân în afara sistemului de fișiere local. Platforma acoperă domenii largi de capabilități, inclusiv aplicarea declarativă a politicilor pentru restricții de sistem de fișiere și rețea, gestionarea credențialelor agentului și monitorizarea activității în timp real. Suportă furnizarea mediilor prin imagini de container personalizate, directoare locale sau cataloage comunitare.

OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio

Agency Swarm is a multi-agent orchestration framework and development kit designed to coordinate specialized AI agents through defined communication patterns and handoffs. It functions as a system for managing agent swarms, providing an API gateway to expose these coordinated collectives as production-ready HTTP endpoints. The project distinguishes itself through its Model Context Protocol integration layer, which connects agents to external data sources and capabilities. It implements specialized orchestration patterns, such as the orchestrator-worker model and role-based delegation, to tran

Archestra is a platform for enterprise AI agent deployment and Model Context Protocol orchestration. It provides a centralized system for configuring specialized agents with specific system prompts and toolsets, and managing the deployment of Model Context Protocol servers that provide large language models with external tools and data sources. The system features an AI agent gateway that exposes configured agents as networked services for external clients and integrated development environments. It incorporates a security suite that provides deterministic guardrails to prevent prompt injecti