1 dépôt
Awesome GitHub RepositoriesModel Runtime Interfaces
Standardized programmatic interfaces that allow ecosystem tools to interact with a model execution engine.
Distinct from API Interfaces: Specific to model runtimes rather than general web application API patterns
Explore 1 awesome GitHub repository matching web development · Model Runtime Interfaces. Refine with filters or upvote what's useful.
Awesome Model Runtime Interfaces GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- vllm-project/vllm-omni
vllm-project/vllm-omni
2,776Voir sur GitHubvllm-omni is a high-throughput serving engine and distributed inference framework designed for omni-modal models. It serves as a multi-modal model API server capable of generating text, image, video, and audio data, providing a standardized interface for remote client access. The system features a non-autoregressive generation engine for parallel media production and a robot policy inference server that acts as a real-time communication bridge to robotic hardware using specialized protocols. It supports hybrid execution models that combine sequential token generation with parallelized media g
Creates a consistent server interface allowing existing ecosystem tools and clients to interact with the model runtime.
Pythonaudio-generationdiffusionimage-generation
