Awesome GitHub RepositoriesGPU Workload Virtualization and Containerization

vcluster is a Kubernetes virtual cluster platform that creates fully isolated Kubernetes environments with dedicated control planes, API servers, and RBAC on shared physical infrastructure. It virtualizes Kubernetes control planes by running them as pods inside a host cluster, as standalone binaries on bare metal or virtual machines, or within Docker containers, providing each tenant their own isolated Kubernetes environment without the overhead of managing separate physical clusters. The platform enables multi-tenant Kubernetes isolation through multiple tenancy models, from shared node pool

WasmEdge is an extensible WebAssembly runtime that executes WebAssembly bytecode in a secure sandbox for cloud, edge, and embedded applications. It functions as a multi-language compiler, compiling applications written in Rust, JavaScript, Go, and Python into WebAssembly bytecode for sandboxed execution, and as a server-side JavaScript runtime that runs JavaScript programs with ES6 modules, NPM packages, and Node.js-compatible APIs. The runtime also serves as an AI inference runtime, executing AI models from JavaScript using WASI-NN plug-ins for inference tasks on personal devices and edge har

gpustack este o platformă de gestionare a clusterelor GPU și un orchestrator de inferență LLM. Acesta funcționează ca un sistem centralizat pentru pooling-ul și orchestrarea unităților de procesare grafică pe servere locale și medii cloud, servind drept manager de calcul eterogen pentru diverse configurații hardware și software. Sistemul oferă un gateway securizat de implementare a modelelor AI care servește modelele ca servicii scalabile folosind autentificarea bazată pe chei. Include un scheduler de resurse GPU care echilibrează sarcinile de lucru pe acceleratoare și coordonează mai multe motoare de inferență pentru a mapa modele AI specifice pe hardware compatibil. Platforma acoperă orchestrarea cuprinzătoare a clusterelor, inclusiv recuperarea automată în caz de eșec, monitorizarea resurselor în timp real și scalarea inferenței distribuite. Încorporează optimizarea performanței prin cuantizare și decodare speculativă pentru a maximiza throughput-ul și a reduce latența. Configurațiile sistemului și starea clusterului sunt menținute prin persistența stării într-o bază de date relațională externă.

JimsGarage is a collection of shell scripts and automation tools designed to help individuals deploy and manage a wide range of self-hosted services on their own hardware. It provides a structured approach to setting up containerized applications, from media servers and document management systems to VPNs and monitoring stacks, all through automated Docker-based configurations. The project distinguishes itself by offering a comprehensive library of deployment recipes that cover the full lifecycle of a home server environment. This includes not just the services themselves, but also the suppor

CRIU is a Linux process checkpointing tool and state manager used to freeze running applications and save their memory and state to disk for later restoration. It functions as a container migration engine and an OCI checkpoint image converter, allowing the live state of running containers to be transferred between different hosts. The project distinguishes itself through its ability to persist network connectivity, acting as a TCP connection state persister that saves and reconstructs network socket states to maintain active communication after a restart. It further enables the distribution o