# intel/llm-scaler

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/intel-llm-scaler).**

378 stars · 45 forks · C++ · Apache-2.0

## Links

- GitHub: https://github.com/intel/llm-scaler
- awesome-repositories: https://awesome-repositories.com/repository/intel-llm-scaler.md

## Description

LLM Scaler is an GenAI solution for text generation, image generation, video generation etc. running on Intel® Arc™ Pro B60 and B70 GPUs. LLM Scalar leverages standard frameworks such as vLLM, ComfyUI, SGLang Diffusion, Xinference etc and ensures the best performance for State-of-Art GenAI…

## Tags

### Part of an Awesome List

- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — Inference optimization for Intel Arc Pro GPU hardware.