1 Repo
Awesome GitHub RepositoriesWorkload-Based Model Selectors
Routes inference requests to the model best suited for the task, optimizing for latency, cost, or accuracy.
Distinct from Request Routing by Model ID: Distinct from Request Routing by Model ID: selects models based on workload characteristics, not just a static model ID.
Explore 1 awesome GitHub repository matching data & databases · Workload-Based Model Selectors. Refine with filters or upvote what's useful.
Awesome Workload-Based Model Selectors GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- vllm-project/semantic-router
vllm-project/semantic-router
3,205Auf GitHub ansehenRoutes each inference request to the model best suited for its task, optimizing for latency, cost, or accuracy.
Goai-gatewaybert-classificationfine-tuning
