1 repo
Awesome GitHub RepositoriesHardware Accelerated AI Runtimes
Environments and tools for executing machine learning models with direct hardware acceleration in isolated containers or virtual machines.
Distinguishing note: Focuses on the infrastructure layer of GPU-accelerated model serving rather than high-level model training frameworks or general-purpose AI libraries.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Hardware Accelerated AI Runtimes. Refine with filters or upvote what's useful.
Awesome Hardware Accelerated AI Runtimes GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- abiosoft/colima
abiosoft/colima
27,035View on GitHubColima is a command-line utility that provides lightweight container runtimes and local Kubernetes orchestration by managing isolated virtual machine environments. It functions as a virtualization manager that abstracts the underlying container engine, allowing users to run containerized applications and system workloads on non-native operating systems without the overhead of heavy desktop software. The project distinguishes itself through its support for hardware-accelerated workloads, enabling direct GPU passthrough to virtual machines for high-performance machine learning tasks. It offers
Enables high-performance machine learning model execution through direct GPU passthrough in secure virtualized environments.
Gocontainerdcontainerd-composecontainers
