1 Repo
Diffusion processes specifically applied to discrete token sequences using masking.
Distinct from Diffusion Models: Distinct from general Diffusion Models by focusing on masked token refinement for language instead of protein or image denoising.
Explore 1 awesome GitHub repository matching part of an awesome list · Masked Text Diffusion. Refine with filters or upvote what's useful.
LLaDA is a masked diffusion language model and conditional text generator. It generates text by iteratively refining masked tokens through a diffusion process rather than predicting the next token in a sequence. The project functions as a vision-language diffusion model, converting visual inputs into text responses. It also serves as a preference optimization framework that uses log-likelihood estimation and evidence lower bounds to tune model responses. The system supports multi-round conversational AI and text sequence evaluation. It integrates vision-language embedding for cross-modal con
Implements a masked diffusion architecture that iteratively refines tokens into final text.