1 Repo
Awesome GitHub RepositoriesTool-Augmented Serving Frameworks
Web-based frameworks that serve fine-tuned models with tool-calling capabilities through chat interfaces and REST endpoints.
Distinct from Model Serving Frameworks: Distinct from Model Serving Frameworks: specifically serves models with tool-calling capabilities, not general model inference.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Tool-Augmented Serving Frameworks. Refine with filters or upvote what's useful.
Awesome Tool-Augmented Serving Frameworks GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- openbmb/toolbench
OpenBMB/ToolBench
5,672Auf GitHub ansehenToolBench is an open platform for training, serving, and evaluating large language models that retrieve and call real-world APIs to complete user instructions. It provides an API-aware inference engine that selects relevant tools from a large corpus and generates sequences of tool calls to produce final answers, along with a custom API registration system that lets users add their own REST endpoints for the model to discover and invoke. The platform includes a complete instruction-tuning pipeline for training models on curated tool-use data, a multi-tool execution engine that coordinates sequ
Provides a web-based chat interface and REST endpoints for serving fine-tuned models with tool-augmented responses.
Python
