1 Repo
Awesome GitHub RepositoriesTool-Using Model API Servings
Exposing a fine-tuned model behind a REST endpoint that accepts a user query and streams back tool-augmented responses.
Distinct from Model Serving Endpoints: Distinct from Model Serving Endpoints: specifically serves a tool-using model via REST, not general model inference endpoints.
Explore 1 awesome GitHub repository matching devops & infrastructure · Tool-Using Model API Servings. Refine with filters or upvote what's useful.
Awesome Tool-Using Model API Servings GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- openbmb/toolbench
OpenBMB/ToolBench
5,672Auf GitHub ansehenToolBench is an open platform for training, serving, and evaluating large language models that retrieve and call real-world APIs to complete user instructions. It provides an API-aware inference engine that selects relevant tools from a large corpus and generates sequences of tool calls to produce final answers, along with a custom API registration system that lets users add their own REST endpoints for the model to discover and invoke. The platform includes a complete instruction-tuning pipeline for training models on curated tool-use data, a multi-tool execution engine that coordinates sequ
Exposes a fine-tuned model behind a REST endpoint that streams back tool-augmented responses.
Python
