# hkunlp/diffullama

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/hkunlp-diffullama).**

395 stars · 31 forks · Python

## Links

- GitHub: https://github.com/hkunlp/diffullama
- awesome-repositories: https://awesome-repositories.com/repository/hkunlp-diffullama.md

## Description

Current Diffusion Language Models (DLMs) have been studied at a smaller scale compared to their autoregressive (AR) counterparts and lack fair comparison on language modeling benchmarks. Additionally, training diffusion models from scratch at scale remains challenging. We propose adapting…

## Tags

### Part of an Awesome List

- [Language Diffusion Models](https://awesome-repositories.com/f/awesome-lists/ai/language-diffusion-models.md) — Adapting autoregressive models to diffusion language models.
- [Training and Alignment](https://awesome-repositories.com/f/awesome-lists/ai/training-and-alignment.md) — Scaling diffusion models via adaptation from autoregressive models.