Awesome GitHub RepositoriesGPU Workload Virtualization and Containerization

vcluster is a Kubernetes virtual cluster platform that creates fully isolated Kubernetes environments with dedicated control planes, API servers, and RBAC on shared physical infrastructure. It virtualizes Kubernetes control planes by running them as pods inside a host cluster, as standalone binaries on bare metal or virtual machines, or within Docker containers, providing each tenant their own isolated Kubernetes environment without the overhead of managing separate physical clusters. The platform enables multi-tenant Kubernetes isolation through multiple tenancy models, from shared node pool

WasmEdge is an extensible WebAssembly runtime that executes WebAssembly bytecode in a secure sandbox for cloud, edge, and embedded applications. It functions as a multi-language compiler, compiling applications written in Rust, JavaScript, Go, and Python into WebAssembly bytecode for sandboxed execution, and as a server-side JavaScript runtime that runs JavaScript programs with ES6 modules, NPM packages, and Node.js-compatible APIs. The runtime also serves as an AI inference runtime, executing AI models from JavaScript using WASI-NN plug-ins for inference tasks on personal devices and edge har

gpustack es una plataforma de gestión de clústeres de GPU y orquestador de inferencia LLM. Funciona como un sistema centralizado para agrupar y orquestar unidades de procesamiento gráfico en servidores locales y entornos en la nube, sirviendo como un gestor de cómputo heterogéneo para diversas configuraciones de hardware y software. El sistema proporciona una puerta de enlace de despliegue de modelos de IA segura que sirve modelos como servicios escalables utilizando autenticación basada en claves. Incluye un programador de recursos de GPU que equilibra las cargas de trabajo entre aceleradores y coordina múltiples motores de inferencia para mapear modelos de IA específicos a hardware compatible. La plataforma cubre una orquestación de clústeres integral, incluyendo recuperación automática de fallos, monitorización de recursos en tiempo real y escalado de inferencia distribuida. Incorpora optimización de rendimiento mediante cuantización y decodificación especulativa para maximizar el rendimiento y reducir la latencia. Las configuraciones del sistema y el estado del clúster se mantienen mediante la persistencia del estado en bases de datos relacionales externas.

JimsGarage is a collection of shell scripts and automation tools designed to help individuals deploy and manage a wide range of self-hosted services on their own hardware. It provides a structured approach to setting up containerized applications, from media servers and document management systems to VPNs and monitoring stacks, all through automated Docker-based configurations. The project distinguishes itself by offering a comprehensive library of deployment recipes that cover the full lifecycle of a home server environment. This includes not just the services themselves, but also the suppor

CRIU is a Linux process checkpointing tool and state manager used to freeze running applications and save their memory and state to disk for later restoration. It functions as a container migration engine and an OCI checkpoint image converter, allowing the live state of running containers to be transferred between different hosts. The project distinguishes itself through its ability to persist network connectivity, acting as a TCP connection state persister that saves and reconstructs network socket states to maintain active communication after a restart. It further enables the distribution o