2 个仓库
Awesome GitHub RepositoriesSemantic Caching
Caching mechanisms that use vector-based semantic matching to retrieve AI model responses.
Distinct from Response Caching: Specializes response caching by using semantic similarity rather than exact key matches.
Explore 2 awesome GitHub repositories matching data & databases · Semantic Caching. Refine with filters or upvote what's useful.
Awesome Semantic Caching GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- alibaba/higress
alibaba/higress
7,558在 GitHub 上查看Higress is an AI API gateway and cloud-native traffic manager that functions as a Kubernetes ingress controller. It provides a centralized system for routing, securing, and optimizing traffic directed toward large language models, AI agents, and microservice architectures. The project distinguishes itself through deep AI orchestration, including the ability to host and manage Model Context Protocol servers that transform REST APIs into tools for AI agents. It features specialized AI infrastructure for model request proxying, protocol translation across multiple providers, and semantic-based c
Stores model responses and dialogue context using semantic matching to reduce token usage and latency.
Goai-gatewayai-nativeapi-gateway - vllm-project/semantic-router
vllm-project/semantic-router
3,205在 GitHub 上查看Caches responses for semantically similar queries using vector-based matching to reduce latency and cost.
Goai-gatewaybert-classificationfine-tuning
