awesome-repositories.com
博客
MCP
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目MCP 服务器关于排名机制媒体报道
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

14 个仓库

Awesome GitHub RepositoriesModel Routing Layers

Middleware that abstracts vendor-specific AI interfaces to dynamically dispatch tasks to various language, vision, or audio models.

Distinguishing note: Focuses on the abstraction and routing layer rather than the models themselves.

Explore 14 awesome GitHub repositories matching artificial intelligence & ml · Model Routing Layers. Refine with filters or upvote what's useful.

Awesome Model Routing Layers GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • affaan-m/eccaffaan-m 的头像

    affaan-m/ECC

    221,981在 GitHub 上查看↗

    ECC 是一个 LLM 智能体编排框架和跨平台 AI 工具套件,旨在协调多模型工作流。它提供了一个用于管理专业智能体角色、可复用技能和结构化规划的系统,以在不同的 AI 驱动代码编辑器中执行复杂的软件开发任务。 该项目作为模型上下文协议(Model Context Protocol)管理器脱颖而出,提供了一个配置层来集成外部服务器并审计工具执行。它进一步实现了一个智能体安全沙箱,限制敏感文件访问并扫描密钥泄露,以保护自主工作流。 该框架涵盖了广泛的能力领域,包括带有测试驱动开发护栏的 AI 编码工作流自动化、通过智能路由实现模型成本优化以及状态隔离的内存管理。它还包括用于强制执行特定语言编码标准和管理跨各种集成开发环境的智能体行为的工具。 该系统通过命令行界面进行管理,该界面处理工具安装、配置修复和工具预设的部署。

    Provides a middleware layer to dynamically dispatch tasks to various models based on complexity and cost.

    JavaScript
    在 GitHub 上查看↗221,981
  • nousresearch/hermes-agentNousResearch 的头像

    NousResearch/hermes-agent

    195,049在 GitHub 上查看↗

    Hermes-agent is an autonomous AI agent framework and runtime designed to execute complex tasks and synthesize new skills from execution traces. It includes a provider-agnostic gateway for routing requests across multiple model backends and a serverless runtime that suspends idle agent instances and resumes them on demand across containers and virtual machines. The project provides a desktop automation toolset that controls native GUI workflows on Linux by querying accessibility APIs and injecting input events. It further distinguishes itself with the ability to generate procedural skills from

    Abstracts model interactions through a unified layer that dispatches requests to various backend AI providers.

    Pythonaiai-agentai-agents
    在 GitHub 上查看↗195,049
  • zhayujie/chatgpt-on-wechatzhayujie 的头像

    zhayujie/chatgpt-on-wechat

    45,353在 GitHub 上查看↗

    This project is an autonomous agent framework designed to integrate large language models with popular messaging platforms. It functions as a middleware platform that enables automated, multimodal interactions by decomposing complex user goals into sequential plans, executing them through external tools, and maintaining persistent context across sessions. The framework distinguishes itself through a modular skill architecture and a hybrid memory system. Users can extend system capabilities by installing custom logic modules from community hubs or generating them through natural language. The

    Decouples the application logic from specific AI providers by dynamically dispatching requests to configured text, vision, or audio models.

    Pythonaiai-agentchatgpt
    在 GitHub 上查看↗45,353
  • openai/openai-agents-pythonopenai 的头像

    openai/openai-agents-python

    27,191在 GitHub 上查看↗

    This project is a Python framework for building autonomous, event-driven agent systems. It provides a unified runtime for orchestrating multi-agent workflows, managing persistent conversation state, and executing code within secure, isolated sandbox environments. The framework is designed to handle complex task delegation, allowing agents to invoke other agents as tools while maintaining context across multi-turn interactions. The framework distinguishes itself through its deep integration with the Model Context Protocol, enabling agents to connect to external data sources and remote services

    Abstracts vendor-specific AI interfaces to dynamically dispatch tasks to various language, vision, or audio models.

    Pythonagentsaiframework
    在 GitHub 上查看↗27,191
  • pytorch/examplespytorch 的头像

    pytorch/examples

    23,752在 GitHub 上查看↗

    This repository serves as a comprehensive collection of reference implementations for the PyTorch machine learning library. It provides practical examples for building, training, and deploying deep learning models, functioning as a toolkit for developers to explore neural network architectures and training workflows. The project distinguishes itself by offering concrete demonstrations of complex machine learning operations, ranging from computer vision tasks like object detection and depth estimation to the training of large-scale transformer models. These examples illustrate how to implement

    Aggregates multiple inference engines into a unified gateway to simplify request routing across various models.

    Python
    在 GitHub 上查看↗23,752
  • nvidia/nemoclawNVIDIA 的头像

    NVIDIA/NemoClaw

    21,237在 GitHub 上查看↗

    NemoClaw is an LLM agent orchestrator and sandboxed execution environment designed to deploy and manage the lifecycles of large language model agents. It provides a secure runtime that isolates persistent agents from the underlying host system to ensure operational security. The system includes a secure LLM inference gateway that acts as a managed routing layer, securing communication between AI agents and inference engines to prevent unauthorized access. It also integrates with NVIDIA OpenShell to run specialized agents within a secure shell environment. Operational control is provided thro

    Implements a centralized routing layer to control access and secure communication between agents and language models.

    TypeScriptai-agentsnvidiaopenclaw
    在 GitHub 上查看↗21,237
  • cft0808/edictcft0808 的头像

    cft0808/edict

    16,123在 GitHub 上查看↗

    Edict is a multi-agent orchestration system and framework designed to coordinate specialized large language model agents. It functions as a workflow designer and orchestrator that decomposes complex objectives into structured plans, using directed acyclic graphs and role-based hierarchies to execute sub-tasks. The system is distinguished by its event-driven architecture, utilizing a publish-subscribe event bus and transactional outbox to manage agent communications and task transitions. It features a dedicated skill management system that allows for the importation, updating, and sandboxed ex

    Provides a configuration layer to dynamically map individual agents to different LLMs to optimize specific personas.

    Python
    在 GitHub 上查看↗16,123
  • nanmicoder/cc-hahaNanmiCoder 的头像

    NanmiCoder/cc-haha

    12,675在 GitHub 上查看↗

    cc-haha is a cross-platform desktop agent and computer use framework that enables large language models to control local operating systems through screenshots, clicks, and keystrokes. It functions as an AI coding workbench and orchestration platform, allowing for the management of multi-project workflows and the coordination of multiple agents executing complex tasks in parallel. The system includes a model backend gateway to connect various artificial intelligence providers and local models to autonomous agents. It features a centralized permission gate for authorizing sensitive commands and

    Includes a middleware layer that abstracts various AI providers to route tasks to specific models.

    TypeScript
    在 GitHub 上查看↗12,675
  • huggingface/chat-uihuggingface 的头像

    huggingface/chat-ui

    10,766在 GitHub 上查看↗

    This project is a web-based user interface for interacting with large language models, featuring streaming responses and persistent conversation history. It functions as an orchestration gateway that directs user prompts to specific language models and acts as a Model Context Protocol client to execute external tools and incorporate live data into conversations. The application includes a routing layer that analyzes input signals and tool requirements to dynamically direct messages to the most appropriate specialized model. It also provides customization settings for brand identity, allowing

    Implements a routing layer that abstracts vendor-specific interfaces to dispatch prompts based on input type.

    TypeScript
    在 GitHub 上查看↗10,766
  • wangrongding/wechat-botwangrongding 的头像

    wangrongding/wechat-bot

    9,806在 GitHub 上查看↗

    This project is a WeChat LLM bot framework and messaging gateway designed to connect WeChat accounts to language models for automated responses and group chat interactions. It functions as an orchestration layer that routes incoming messages to AI agents and returns generated responses to users. The system distinguishes itself through a provider-agnostic routing mechanism that distributes messages across various cloud-based and local language model services. It includes a command-line interface for managing login sessions, searching chat history, and sending messages, as well as a whitelist-b

    Provides a middleware abstraction layer to dispatch messages across multiple cloud-based and local AI model providers.

    JavaScriptchatgptopenaiwechat
    在 GitHub 上查看↗9,806
  • ai4finance-foundation/finrobotAI4Finance-Foundation 的头像

    AI4Finance-Foundation/FinRobot

    6,252在 GitHub 上查看↗

    FinRobot is an AI-powered financial analysis framework that coordinates multiple specialized agents to automate equity research, financial analysis, and investment risk assessment. At its core, it functions as a multi-agent orchestration system where a director and task manager allocate financial tasks to the most suitable large language models based on performance metrics and task requirements. The framework distinguishes itself through its ability to execute complex multi-step financial workflows by routing tasks through perception, reasoning, and action modules. It generates professional e

    Selects and assigns the optimal large language model for each financial task based on performance metrics.

    Jupyter Notebookaiagentchatgptfinance
    在 GitHub 上查看↗6,252
  • 21st-dev/1code21st-dev 的头像

    21st-dev/1code

    5,549在 GitHub 上查看↗

    1code is an AI-assisted development environment that provides a unified interface for switching between multiple AI coding agents. It toggles between a read-only analysis mode and a full execution mode, asking clarifying questions, building structured plans with previews, and requiring user approval before making code changes. The environment integrates with external services and tools through the Model Context Protocol (MCP), enabling connections to databases, project management systems, and code repositories. Agent sessions can run either locally or in persistent cloud sandboxes that stay al

    Provides a model routing layer that abstracts vendor-specific AI interfaces to dispatch tasks to various coding agents.

    TypeScript
    在 GitHub 上查看↗5,549
  • dtyq/magicdtyq 的头像

    dtyq/magic

    4,866在 GitHub 上查看↗

    Magic 是一个一体化的生产力环境和代理平台,专为部署、编排和管理多代理工作流而设计。它作为一个协调系统,将复杂任务分派给专门的代理,既作为工作流引擎,也作为知识管理系统,将来自 PDF、网站和数据库的信息合成为结构化的数字资产。 该平台通过能够生成专业业务交付成果(包括高保真图形资产、技术图表和演示文稿)的多模态内容套件脱颖而出。它包含一个路由层,将特定目标匹配到最合适的语言模型,并允许通过对话界面和外部技能生态系统集成创建新功能。 广泛的功能领域包括企业知识管理(将内部数据转换为可重用的 AI 工作者)以及具有部门和用户级细粒度预算跟踪的全面成本管理。该系统还提供用于实时项目共享的协作环境,以及具有沙箱容器化执行和针对高风险操作的人机协同审批工作流的安全框架。 包括集群和服务在内的全栈可以使用自动化部署脚本安装在私有的 macOS 或 Linux 环境中。

    Employs a routing layer to match tasks to the optimal AI model based on specific requirements.

    TypeScriptagentagiai
    在 GitHub 上查看↗4,866
  • vllm-project/semantic-routervllm-project 的头像

    vllm-project/semantic-router

    3,205在 GitHub 上查看↗

    Routes requests across local, private, and frontier models through a single layer from edge devices to the cloud.

    Goai-gatewaybert-classificationfine-tuning
    在 GitHub 上查看↗3,205
  1. Home
  2. Artificial Intelligence & ML
  3. Model Routing Layers