3 repositorios
Systems that direct requests to specific models based on content similarity and embedding matching.
Distinguishing note: Focuses on intelligent request dispatching based on semantic content, not just load balancing.
Explore 3 awesome GitHub repositories matching artificial intelligence & ml · Semantic Routers. Refine with filters or upvote what's useful.
LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc
Routes incoming requests to specialized models by matching input content against examples using embedding-based similarity.
bRAG-langchain is a framework for building retrieval augmented generation pipelines using LangChain to connect documents with language models. It functions as a vector store orchestrator that manages document indexing and retrieval strategies to improve context accuracy. The system implements an advanced retrieval pipeline featuring a semantic query router that directs natural language inputs to specific data sources or prompts. It includes a metadata filtering engine that translates natural language queries into structured schemas to narrow search results. The project covers hybrid search o
Routes natural language inputs to specific data sources or prompts based on semantic similarity.
Routes inference requests to the optimal model based on semantic meaning, cost, latency, and safety signals.