1 Repo
Awesome GitHub RepositoriesLLM
Platforms for managing, monitoring, and billing multi-model LLM API access with caching and moderation.
Distinct from API Management Platforms: Distinct from API Management Platforms: focuses on LLM-specific features like token metering, model routing, and response caching.
Explore 1 awesome GitHub repository matching devops & infrastructure · LLM. Refine with filters or upvote what's useful.
Awesome LLM GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- coaidev/coai
coaidev/coai
9,212Auf GitHub ansehenCoAI is an enterprise-grade, self-hostable AI gateway platform that unifies access to over 200 AI models from more than 35 providers through a single OpenAI-compatible API endpoint. It functions as a multi-tenant gateway, routing requests across providers with load balancing, automatic failover, and priority-based routing, while exposing standard OpenAI API endpoints for chat, image generation, model listing, and billing to enable seamless integration with existing tools and clients. The platform distinguishes itself through a comprehensive set of operational capabilities built around the gat
Manages, monitors, and bills multi-model AI API access with built-in caching, moderation, and usage analytics.
TypeScriptai-gatewayapichat
