How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
Training Optimal Large Diffusion Language Models Jinjie Ni†, Qian Liu, Chao Du, Longxu Dou, Hang Yan, Zili Wang, Tianyu Pang, Michael Qizhe Shieh
](https://huggingface.co/Dream-org/Dream-v0-Base-7B)
We introduce LLaDA 1.5, a competitive large diffusion language model, trained by variance-reduced preference optimization (VRPO).
Current Diffusion Language Models (DLMs) have been studied at a smaller scale compared to their autoregressive (AR) counterparts and lack fair comparison on language modeling benchmarks. Additionally, training diffusion models from scratch at scale remains challenging. We propose adapting…
The main features of hkunlp/diffullama are: Language Diffusion Models, Training and Alignment.
Open-source alternatives to hkunlp/diffullama include: jinjieni/quokka — Training Optimal Large Diffusion Language Models Jinjie Ni†, Qian Liu, Chao Du, Longxu Dou, Hang Yan, Zili Wang,… ml-gsai/llada-1.5 — We introduce LLaDA 1.5, a competitive large diffusion language model, trained by variance-reduced preference… hkunlp/dream — ](https://huggingface.co/Dream-org/Dream-v0-Base-7B). jinjieni/megadlms — MegaDLMs. autonomousvision/mdpo — [[Paper]](https://arxiv.org/pdf/2508.13148) [[Project]](https://cli212.github.io/MDPO/). amap-ml/ar-map — Are Autoregressive Large Language Models Implicit Teachers for Diffusion Large Language Models? A comprehensive…