# jd-opensource/xllm

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/jd-opensource-xllm).**

1,369 stars · 240 forks · C++ · Apache-2.0

## Links

- GitHub: https://github.com/jd-opensource/xllm
- Homepage: https://xllm-ai.com/
- awesome-repositories: https://awesome-repositories.com/repository/jd-opensource-xllm.md

## Description

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.

## Tags

### Part of an Awesome List

- [Inference and Serving](https://awesome-repositories.com/f/awesome-lists/ai/inference-and-serving.md) — High-performance inference engine for diverse hardware.
- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — High-performance inference engine for diverse accelerators.