# lancelot39/diffusionnat

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/lancelot39-diffusionnat).**

3 stars · 1 forks · Python

## Links

- GitHub: https://github.com/Lancelot39/DiffusionNAT
- awesome-repositories: https://awesome-repositories.com/repository/lancelot39-diffusionnat.md

## Description

1.we propose a new solution for integrating Pre-trained LM into Diffusion Model, to perform discrete diffusion for text-to-text generation. It requires only low-cost fine-tuning and can performs better than vanilla fine-tuning;

## Tags

### Part of an Awesome List

- [Language Diffusion Models](https://awesome-repositories.com/f/awesome-lists/ai/language-diffusion-models.md) — Self-prompting discrete diffusion for non-autoregressive generation.