LLaDA is a masked diffusion language model and conditional text generator. It generates text by iteratively refining masked tokens through a diffusion process rather than predicting the next token in a sequence. The project functions as a vision-language diffusion model, converting visual inputs into text responses. It also serves as a preference optimization framework that uses log-likelihood estimation and evidence lower bounds to tune model responses. The system supports multi-round conversational AI and text sequence evaluation. It integrates vision-language embedding for cross-modal con
This repo contains a PyTorch implementation for the paper Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution by Aaron Lou, Chenlin Meng and Stefano Ermon.
By Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush, Volodymyr Kuleshov
Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles" (Slow Fast Sampling).
Code repository for the paper Think While You Generate: Discrete Diffusion with Planned Denoising, by Sulin Liu, Juno Nam, Andrew Campbell, Hannes Stärk, Yilun Xu, Tommi Jaakkola, Rafael Gómez-Bombarelli. Tweet and video for the main idea.
The main features of liusulin/ddpd are: Discrete Diffusion Models, Language Diffusion Models, Inference Optimization.
Open-source alternatives to liusulin/ddpd include: ml-gsai/llada — LLaDA is a masked diffusion language model and conditional text generator. It generates text by iteratively refining… s-sahoo/duo — By Subham Sekhar Sahoo, Justin Deschenaux, Aaron Gokaslan, Guanghan Wang, Justin Chiu, Volodymyr Kuleshov. kuleshov-group/mdlm — By Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush,… liangrunflora/slow-fast-sampling — Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The… louaaron/score-entropy-discrete-diffusion — This repo contains a PyTorch implementation for the paper Discrete Diffusion Modeling by Estimating the Ratios of the… s-sahoo/eso-lms — Subham Sekhar Sahoo \ 1 , Zhihan Yang \ 2 , Yash Akhauri †1 , Johnna Liu †1 , Deepansha Singh †1 , Zhoujun Cheng †3 ,…