Awesome GitHub RepositoriesGPU Workload Virtualization and Containerization

vcluster is a Kubernetes virtual cluster platform that creates fully isolated Kubernetes environments with dedicated control planes, API servers, and RBAC on shared physical infrastructure. It virtualizes Kubernetes control planes by running them as pods inside a host cluster, as standalone binaries on bare metal or virtual machines, or within Docker containers, providing each tenant their own isolated Kubernetes environment without the overhead of managing separate physical clusters. The platform enables multi-tenant Kubernetes isolation through multiple tenancy models, from shared node pool

WasmEdge is an extensible WebAssembly runtime that executes WebAssembly bytecode in a secure sandbox for cloud, edge, and embedded applications. It functions as a multi-language compiler, compiling applications written in Rust, JavaScript, Go, and Python into WebAssembly bytecode for sandboxed execution, and as a server-side JavaScript runtime that runs JavaScript programs with ES6 modules, NPM packages, and Node.js-compatible APIs. The runtime also serves as an AI inference runtime, executing AI models from JavaScript using WASI-NN plug-ins for inference tasks on personal devices and edge har

gpustack هي منصة إدارة مجموعات GPU ومنسق استدلال LLM. تعمل كنظام مركزي لتجميع وتنسيق وحدات معالجة الرسومات عبر الخوادم المحلية وبيئات السحابة، وتعمل كمدير حوسبة غير متجانس لتكوينات الأجهزة والبرامج المتنوعة. يوفر النظام بوابة نشر نموذج ذكاء اصطناعي آمنة تخدم النماذج كخدمات قابلة للتوسع باستخدام مصادقة قائمة على المفاتيح. يتضمن مجدول موارد GPU يوازن أعباء العمل عبر المسرعات وينسق محركات استدلال متعددة لرسم خرائط نماذج ذكاء اصطناعي محددة لأجهزة متوافقة. تغطي المنصة تنسيق المجموعات الشامل، بما في ذلك استعادة الفشل الآلي، ومراقبة الموارد في الوقت الفعلي، وتوسيع نطاق الاستدلال الموزع. يدمج تحسين الأداء من خلال التكميم وفك التشفير التخميني لزيادة الإنتاجية وتقليل زمن الوصول. يتم الحفاظ على تكوينات النظام وحالة المجموعة عبر استمرارية حالة قاعدة بيانات علائقية خارجية.

JimsGarage is a collection of shell scripts and automation tools designed to help individuals deploy and manage a wide range of self-hosted services on their own hardware. It provides a structured approach to setting up containerized applications, from media servers and document management systems to VPNs and monitoring stacks, all through automated Docker-based configurations. The project distinguishes itself by offering a comprehensive library of deployment recipes that cover the full lifecycle of a home server environment. This includes not just the services themselves, but also the suppor

CRIU is a Linux process checkpointing tool and state manager used to freeze running applications and save their memory and state to disk for later restoration. It functions as a container migration engine and an OCI checkpoint image converter, allowing the live state of running containers to be transferred between different hosts. The project distinguishes itself through its ability to persist network connectivity, acting as a TCP connection state persister that saves and reconstructs network socket states to maintain active communication after a restart. It further enables the distribution o