1 repo
Awesome GitHub RepositoriesRequest Routers
Systems that distribute AI model queries across multiple endpoints based on performance and cost.
Distinguishing note: Focuses on traffic management and load balancing for AI models, distinct from general API gateways.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Request Routers. Refine with filters or upvote what's useful.
Awesome Request Routers GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- BerriAI/litellm
BerriAI/litellm
36,376View on GitHubLiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc
Distributes model queries across various deployments based on cost, performance, and availability rules.
Pythonai-gatewayanthropicazure-openai
