1 repository
Awesome GitHub RepositoriesRuntime Library Distributions
Prebuilt packages and images providing a standardized environment for executing models on target systems.
Distinct from Runtime Extension Distribution: None of the candidates describe the distribution of a prebuilt AI runtime environment.
Explore 1 awesome GitHub repository matching devops & infrastructure · Runtime Library Distributions. Refine with filters or upvote what's useful.
Awesome Runtime Library Distributions GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- openvinotoolkit/openvino
openvinotoolkit/openvino
10,414Vezi pe GitHubOpenVINO is an AI inference engine and model serving platform designed to execute optimized deep learning models across CPUs, GPUs, and NPUs through a unified API. It includes a model optimization toolkit for converting, quantizing, and compressing models from various frameworks, alongside a specialized generative AI runtime for large language models. The project distinguishes itself through a plugin-based hardware acceleration layer that maps neural network operations to vendor-specific drivers. It features advanced execution mechanisms such as continuous batching, speculative decoding, and
Distributes the runtime environment via prebuilt packages or images to enable model execution on target systems.
C++aicomputer-visiondeep-learning
