1 个仓库
Awesome GitHub RepositoriesWorkload-Based Model Selectors
Routes inference requests to the model best suited for the task, optimizing for latency, cost, or accuracy.
Distinct from Request Routing by Model ID: Distinct from Request Routing by Model ID: selects models based on workload characteristics, not just a static model ID.
Explore 1 awesome GitHub repository matching data & databases · Workload-Based Model Selectors. Refine with filters or upvote what's useful.
Awesome Workload-Based Model Selectors GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- vllm-project/semantic-router
vllm-project/semantic-router
3,205在 GitHub 上查看Routes each inference request to the model best suited for its task, optimizing for latency, cost, or accuracy.
Goai-gatewaybert-classificationfine-tuning
