Open-source alternatives to Easy GPU PV

Cortex is a Kubernetes-based machine learning infrastructure platform designed for deploying, scaling, and managing models and workloads. It functions as a serverless inference engine and GPU cluster orchestrator, providing the tools necessary to execute real-time, asynchronous, and batch model predictions. The platform utilizes declarative infrastructure-as-code for provisioning model clusters and environments. It optimizes operational costs by elastically scaling CPU and GPU resources through the use of spot instances. The system covers a broad set of operational capabilities, including wo

CloudStack is an infrastructure-as-a-service orchestration engine designed to automate the deployment and lifecycle of computing, storage, and networking resources within a software-defined data center. It serves as a management layer for provisioning private clouds and managing the delivery of virtual machines and persistent storage across virtualized physical infrastructure. The platform features a multi-hypervisor orchestrator that utilizes a hypervisor-agnostic abstraction layer to control diverse virtualization technologies through a unified set of standardized API calls. It further prov

This project is a distributed computing platform designed to orchestrate containerized workloads across heterogeneous hardware clusters. It functions as a centralized control plane that manages resource allocation, scheduling, and execution environments, enabling organizations to share high-performance computing infrastructure securely among multiple users and projects. The platform distinguishes itself through advanced hardware virtualization and multi-tenant management capabilities. It supports the partitioning of physical graphics processing units into fractional slices, allowing multiple

Nebullvm is an AI inference accelerator, GPU resource orchestrator, and performance optimization library for large language models. It functions as an optimization layer designed to lower operational costs by aligning model execution with underlying hardware architectures. The system maximizes cluster efficiency through real-time dynamic partitioning and elastic quotas for shared hardware resources. It employs alignment methods and techniques to reduce the hardware and data requirements necessary for tuning large language models. The project covers broad capability areas including AI infrast

Higgsfield is a distributed machine learning training framework and GPU cluster orchestrator designed for scaling neural networks with billions of parameters. It functions as a large model sharding system and a containerized deployment tool to manage computational workflows across heterogeneous compute resources. The platform provides a centralized interface for experiment management, enabling the monitoring of real-time telemetry, performance metrics, and logs. It ensures reproducible results by using container isolation to standardize dependencies across different computing environments. T

Vagrant is a virtual machine environment manager and development environment provisioner. It functions as an infrastructure as code tool and multi-hypervisor orchestrator, allowing for the definition and automation of virtualized development environments through a single configuration file. The project enables the creation of portable, virtualized development environments to ensure consistency across different host operating systems. It supports deploying these environments across various backends, including local hypervisors, cloud providers, and container runtimes, using a unified interface

vgpu_unlock is a set of software tools and driver modifications designed to unlock enterprise-grade virtualization features on consumer graphics hardware. It functions as a vGPU unlock tool and hardware device ID spoofer that allows a single graphics card to be shared across multiple virtual machines. The project achieves this by employing driver-level hooking, dynamic memory patching, and kernel-level device spoofing. These techniques intercept hardware identification queries and modify the operational state of the GPU driver at runtime to bypass manufacturer-imposed software restrictions.

This project is a Kubernetes device plugin designed for graphics hardware resource management. It implements a standardized plugin protocol to register physical accelerators with the cluster scheduler, enabling the automated allocation and scheduling of hardware-accelerated workloads. The system focuses on multi-tenant GPU sharing to maximize hardware utilization. It achieves this through various sharing strategies, including the logical partitioning of monolithic hardware units into isolated segments and time-slicing to interleave execution cycles across multiple concurrent containers. The

FedML is a distributed machine learning training library, federated learning framework, and GPU workload orchestrator. It provides the core system components necessary to execute large-scale model training and fine-tuning across multi-cloud, on-premise, and decentralized GPU clusters, while offering a dedicated engine for scalable model serving and an MLOps pipeline manager for end-to-end lifecycle management. The platform distinguishes itself by enabling privacy-preserving federated learning across decentralized edge devices and organizational silos, keeping raw data on local hardware. It al

gpustack is a GPU cluster management platform and LLM inference orchestrator. It functions as a centralized system for pooling and orchestrating graphics processing units across local servers and cloud environments, serving as a heterogeneous compute manager for diverse hardware and software configurations. The system provides a secure AI model deployment gateway that serves models as scalable services using key-based authentication. It includes a GPU resource scheduler that balances workloads across accelerators and coordinates multiple inference engines to map specific AI models to compatib

Packer is a machine image builder and multi-platform image orchestrator used to create identical virtual machine images for multiple platforms from a single source configuration. It functions as an infrastructure as code tool, utilizing the HashiCorp Configuration Language to define versioned and reproducible templates for cloud image provisioners. The tool is distinguished by its plugin-based extension model, which allows it to load external binaries for builders and provisioners to support various cloud platforms and virtualization environments. It includes a post-processor pipeline to tran

Quickemu is a command-line utility designed to automate the deployment and management of virtual machine instances. It functions as an automated provisioner that handles the acquisition of operating system images and the generation of optimized configuration files, allowing users to launch virtualized environments with minimal manual setup. The tool leverages hardware-accelerated emulation to execute virtual machines, mapping host-native resources directly to the guest environment to maintain performance. It utilizes shell-scripted orchestration to manage the lifecycle of these instances, sto

Volcano is a Kubernetes-native batch scheduler specialized for AI, machine learning, and high-performance computing workloads. It provides gang scheduling to atomically allocate resources for all tasks of a distributed job, preventing deadlocks from partial allocation, and supports hierarchical queue management for multi-tenant resource isolation with configurable quotas, borrowing, and preemption. Topology-aware placement optimizes communication-intensive workloads by modeling network hierarchy to minimize cross-switch latency. Volcano differentiates itself with automated orchestration of di

Olares is a comprehensive suite of self-hosted identity, storage, AI, and orchestration services designed for private infrastructure management. It functions as a Kubernetes home server orchestrator, enabling the deployment of containerized applications, AI models, and GPU resources on local hardware to replace third-party cloud services. The platform distinguishes itself through a combination of self-hosted AI infrastructure for running large language models and image generators, alongside a decentralized identity manager that uses cryptographic keys and OIDC for trustless authentication. It

Bloatynosy is a unified Windows system management tool that removes pre-installed bloatware, manages optional features, configures privacy settings, cleans residual files, and controls Windows updates. It operates through a core system interaction layer that leverages Appx, DISM, PowerShell, Registry, COM, Task Scheduler, and Windows Update APIs to apply configuration changes and manage system state. The tool provides a streamlined post-install and ongoing configuration experience, guiding users through initial setup to skip unwanted prompts and configure privacy early. It suppresses intrusiv

ThisIsWin11 is a suite of utilities and scripts designed for Windows 11 that functions as a bloatware remover, operating system customization tool, package manager interface, and system automation suite. Its primary purpose is to identify and delete factory-installed applications to reclaim system resources and modify system behavior and visual styles. The project provides a centralized control panel for managing obscure system settings and personalizing visual interface elements. It leverages script-based automation to apply wide-scale configurations and utilizes registry-based modifications

pysheeet is a technical reference library providing a curated collection of code snippets and implementation patterns for advanced Python development, system integration, and high-performance computing. It serves as a comprehensive guide for implementing low-level network programming, native C extensions, and asynchronous and concurrent programming. The project provides specialized frameworks for the development and deployment of large language models, including tools for distributed GPU inference and high-performance serving. It also includes detailed patterns for high-performance computing

This project is a PowerShell-based post-installation automation suite and configuration manager designed to optimize Windows 10 and Windows Server deployments. It functions as a system optimization tool that applies idempotent tweaks to ensure an operating system reaches a specific desired state after a fresh installation. The tool distinguishes itself through the use of preset-based task orchestration and a modular tweak library. It allows for the definition of custom setup presets via external files and supports the extension of its capabilities through the import of custom modules. Every s

AISystem is a comprehensive AI full-stack infrastructure project covering the entire pipeline from AI chip architecture to high-level training frameworks. It encompasses the development of AI compiler frameworks, inference engines, and distributed training orchestrators designed to coordinate workloads across a heterogeneous compute stack of CPUs, GPUs, and NPUs. The project focuses on the deep integration of software and hardware, employing software-hardware co-design to align tensor layouts with physical memory structures. It provides specialized capabilities for accelerating Transformer mo

KubeOperator is a comprehensive Kubernetes cluster management platform, infrastructure orchestrator, and multi-cluster manager. It functions as an enterprise Kubernetes distribution designed to automate the deployment, scaling, and lifecycle management of production clusters across diverse cloud platforms and physical machines. The platform distinguishes itself with specialized capabilities for air-gapped environments, including an offline installation engine that generates software archives and manages private registries for secure, non-internet deployments. It also provides a centralized da

OpCore-Simplify is an automated tool that generates a complete OpenCore EFI folder for Hackintosh builds. It scans the system hardware to identify supported devices and compatible macOS versions, then assembles a bootable EFI configuration by downloading the latest OpenCore bootloader and required kernel extensions from official sources. The tool differentiates itself by automating the entire EFI creation process, from hardware detection through patch application. It automatically selects and applies the correct ACPI hotfixes and kernel extensions based on the detected hardware and target mac

This project is a PyTorch model serving framework designed to deploy and scale machine learning models in production via scalable network endpoints. It functions as a high-performance inference server, optimizer, and model lifecycle manager that handles model loading, request batching, and hardware acceleration. The system distinguishes itself through advanced orchestration and optimization capabilities, such as chaining multiple models into sequential workflows using execution graphs and employing dynamic batching to improve throughput and latency. It provides specialized support for generat

This project is an administrative utility suite designed to optimize Windows 11 environments through automated script execution. It functions by modifying core system configurations, removing pre-installed software packages, and terminating non-essential background processes to reclaim system resources and storage space. The tool distinguishes itself by providing a structured approach to privacy management and system maintenance. It programmatically updates registry keys and system settings to disable telemetry and background data collection, while offering state-reversion capabilities that a

Cube Studio is a cloud-native MLOps platform and Kubernetes-based AI orchestrator designed for the entire machine learning lifecycle. It provides a distributed training framework for large-scale model fine-tuning, a GPU resource manager for hardware virtualization, and an ML pipeline orchestrator that uses visual directed acyclic graphs to manage end-to-end workflows. The platform distinguishes itself through its specialized LLM inference server, which supports retrieval-augmented generation and the construction of private knowledge bases. It features a dedicated system for supervised fine-tu

This project is a collection of shell-based automation scripts designed to automate the deployment and configuration of Linux containers and virtual machines on Proxmox VE hosts. It provides toolsets for the scripted provisioning of virtual machine infrastructure and the creation of pre-defined containers for various applications. The toolset includes specialized utilities for Proxmox host management, such as automating post-installation setup, managing system backups, and cleaning up old kernels to reclaim disk space. It further provides automated configurations for hardware passthrough, ena

F Prime is a component-based framework designed for the development and deployment of embedded and spaceflight software. It provides a modular architecture that decouples software logic from communication interfaces, allowing developers to define system structures through a domain-specific modeling language. This model-based approach enables automated code generation, ensuring consistency across complex system topologies while maintaining strict interface contracts between software modules. The framework distinguishes itself through its integrated build system and ground data operations suite

Privatezilla is a Windows privacy hardening tool designed to audit security settings, remove pre-installed software, and block outbound telemetry data. It functions as an operating system security auditor and a telemetry blocker to restrict data transmission from third-party applications. The project provides automated utilities for removing built-in applications and cloud services. It employs firewall rules and host file restrictions to prevent unauthorized information collection and stop data transmission to external servers. The tool covers a broad range of system management capabilities,