1 repository
API routing that exposes legacy, OpenAI-compatible, and core endpoints simultaneously for client choice.
Distinct from API Versioning: Distinct from API Versioning: focuses on offering multiple interface types (legacy, OpenAI, core) rather than versioning a single interface.
Explore 1 awesome GitHub repository matching web development · Multi-Interface Routers. Refine with filters or upvote what's useful.
SakuraLLM is a multi-format document translation system that hosts large language models for translating Japanese text into other languages. It functions as an inference server that exposes translation models through an OpenAI-compatible API, allowing any tool supporting the OpenAI client format to send translation requests. The system is designed as a glossary-aware translation engine that applies user-defined term dictionaries to ensure consistent translation of proper nouns and names across outputs. The project distinguishes itself by supporting multiple high-performance inference backends
Registers legacy, OpenAI-compatible, and core router endpoints so clients can choose their preferred interface.