How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Experiential is an open-source LLM gateway and router. It exposes OpenAI-compatible and Anthropic-compatible APIs in front of hosted models, models reached with your own provider keys, and local models, all under one base URL and one bearer key. Existing OpenAI and Anthropic SDK clients, as well as coding agents, can be pointed at it by changing only the endpoint. The project states that usage carries zero markup.
The main features of experientiallabs/experiential are: LLM Gateways, Trace-Learned Router Builders, OpenAI-Compatible APIs, Anthropic-Compatible Endpoints, OpenAI-Compatible Endpoints, Model Request Routing, Cost-Aware Model Routers, LLM Traffic Trace Collection.
Projects with overlapping indexed features include: nvidia-nemo/switchyard — Switchyard is a Rust library for routing large language model requests. For each request it chooses which model and… helicone/helicone — Helicone is an AI gateway and observability platform designed to intercept, manage, and monitor interactions with… mnfst/llm-gateway — LLM Gateway is an open-source, self-hostable gateway that sits between applications and AI model providers. It accepts… lm-sys/routellm — RouteLLM is a routing framework and traffic manager designed to direct prompts between high-capability and low-cost… tashfeenahmed/freellmapi — freellmapi is a self-hosted gateway that combines the free tiers of many language model providers behind one local,… xiangsx/gpt4free-ts — gpt4free-ts is a TypeScript-based LLM API proxy and gateway that provides a unified interface for accessing large…
Switchyard is a Rust library for routing large language model requests. For each request it chooses which model and provider should respond, balancing answer quality, cost, and response time rather than relying on one fixed model. It is aimed at coding assistants and agent harnesses, where it picks the best available model for each step and can show the chosen model in a tool's status line. Routing decisions come from composable strategies. A language model can judge whether a cheaper, more efficient model can handle a task, and that verdict selects the model tier. Execution signals, such as
Helicone is an AI gateway and observability platform designed to intercept, manage, and monitor interactions with large language models. By acting as a reverse-proxy, it provides a centralized layer for routing requests across multiple AI providers, allowing developers to maintain consistent application logic while gaining deep visibility into model performance, usage, and costs. The platform distinguishes itself through a robust suite of traffic management and prompt engineering tools. It enables policy-driven control, including automatic failover between providers, rate limiting, and edge-b
LLM Gateway is an open-source, self-hostable gateway that sits between applications and AI model providers. It accepts requests at a single OpenAI-compatible chat completions endpoint, so any SDK that allows a custom base URL can send traffic through it, and forwards each request to a suitable model from the connected providers. Each agent uses its own key, and a PostgreSQL database backs the service. What sets it apart is the routing and cost layer. It can score each request and send it to the cheapest model able to handle it, pick a model automatically when the model is set to auto, or appl
RouteLLM is a routing framework and traffic manager designed to direct prompts between high-capability and low-cost large language models. It functions as an API gateway that mimics the OpenAI specification to route requests across different model providers. The system optimizes operational costs by splitting traffic between model tiers based on predicted win rates and prompt complexity. It includes a calibration tool to analyze sample queries and determine the optimal cost-quality tradeoff for traffic distribution. The framework provides a tool for measuring the accuracy and cost efficiency