1 dépôt
Awesome GitHub RepositoriesIntegrated GPU Memory Limits
Mechanisms for restricting the fraction of integrated GPU memory usable on CUDA systems with iGPUs.
Distinct from GPU Memory Optimizers: Distinct from GPU Memory Optimizers: focuses specifically on limiting iGPU memory usage, not general VRAM optimization for large models.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Integrated GPU Memory Limits. Refine with filters or upvote what's useful.
Awesome Integrated GPU Memory Limits GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- ericlbuehler/mistral.rs
EricLBuehler/mistral.rs
6,597Voir sur GitHubmistral.rs is an inference engine for large language models that runs locally and exposes models behind OpenAI and Anthropic-compatible APIs. It serves as a multi-model serving platform, capable of loading several models in a single server process with per-request routing and on-demand loading and unloading. The engine supports multimodal inference, processing text alongside images, video, audio, and speech inputs, and includes a quantized model deployment runtime that reduces memory use and speeds up inference on consumer hardware. The project distinguishes itself through an agentic tool exe
Restricts the fraction of integrated GPU memory usable on CUDA systems with iGPUs.
Rustllmrustuqff
