# inclusionai/dinfer

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/inclusionai-dinfer).**

472 stars · 45 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/inclusionAI/dInfer
- awesome-repositories: https://awesome-repositories.com/repository/inclusionai-dinfer.md

## Description

dInfer is an efficient and extensible inference framework for dLLMs. As illustrated in the following architecture, it modularizes inference into four components: model, diffusion iteration manager, decoder and KV-cache manager. It provides well-designed APIs for flexible algorithms combinations…

## Tags

### Part of an Awesome List

- [Inference Optimization](https://awesome-repositories.com/f/awesome-lists/devtools/inference-optimization.md) — Efficient inference framework for diffusion language models.