1 个仓库
Awesome GitHub RepositoriesTool-Using Model Servings
Running a fine-tuned model behind a web server that accepts user queries and streams back tool-augmented responses.
Distinct from Model Serving: Distinct from Model Serving: specifically serves a model that retrieves and calls APIs, not general model inference.
Explore 1 awesome GitHub repository matching web development · Tool-Using Model Servings. Refine with filters or upvote what's useful.
Awesome Tool-Using Model Servings GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- openbmb/toolbench
OpenBMB/ToolBench
5,672在 GitHub 上查看ToolBench is an open platform for training, serving, and evaluating large language models that retrieve and call real-world APIs to complete user instructions. It provides an API-aware inference engine that selects relevant tools from a large corpus and generates sequences of tool calls to produce final answers, along with a custom API registration system that lets users add their own REST endpoints for the model to discover and invoke. The platform includes a complete instruction-tuning pipeline for training models on curated tool-use data, a multi-tool execution engine that coordinates sequ
Runs a fine-tuned model behind a web server that streams back tool-augmented responses.
Python
