1 Repo
Awesome GitHub RepositoriesGenerative
Specialized processes for transforming generative AI models into optimized intermediate representations.
Distinct from Model Conversion: Specifically targets generative architectures (like LLMs or Diffusion models) rather than generic model conversion.
Explore 1 awesome GitHub repository matching devops & infrastructure · Generative. Refine with filters or upvote what's useful.
Awesome Generative GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- openvinotoolkit/openvino
openvinotoolkit/openvino
10,414Auf GitHub ansehenOpenVINO is an AI inference engine and model serving platform designed to execute optimized deep learning models across CPUs, GPUs, and NPUs through a unified API. It includes a model optimization toolkit for converting, quantizing, and compressing models from various frameworks, alongside a specialized generative AI runtime for large language models. The project distinguishes itself through a plugin-based hardware acceleration layer that maps neural network operations to vendor-specific drivers. It features advanced execution mechanisms such as continuous batching, speculative decoding, and
Provides specialized conversion of generative models into optimized intermediate representations for efficient execution.
C++aicomputer-visiondeep-learning
