Projects sharing features with Ml Diffucoder

```bash conda create -n tad python=3.10 -y conda activate tad

Blockwise SFT for Diffusion Language Models: Reconciling Bidirectional Attention and Autoregressive Decoding

This repository contains the code and models for our paper DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models.

This repository contains the official implementation of training and inference as well as the pre-trained weights for the Family of Diffusion Protein Language Models (DPLM), including: - DPLM from ICML'24 paper "Diffusion Language Models Are Versatile Protein Learners", which introduces…

Qingyu Lu 1,3 , Liang Ding 2 , Kanjian Zhang 2 , Jinxia Zhang 1 , Dacheng Tao 3

Implimentation of DiffuDetox, based on DiffuSeq.

This is the code for the AAAI 2024 Paper: Text-Guided Molecule Generation with Diffusion Language Model.

This repository contains the code to reproduce the experiments in ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts.

d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning A two-stage approach combining masked SFT with diffu -GRPO—a novel policy gradient method based on GRPO that features efficient log probability estimation designed for masked dLLMs—to scale reasoning capabilities…

SPG: Sandwiched Policy Gradient for Masked Diffusion Language Models

Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models Most comprehensive framework for dLLM's and multimodal dLLM's post-training

Source code of IPED

This is the official implementation of the paper d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation (ICML'26), where we introduce a novel recipe for building an ultra-fast diffusion language model named d3LLM (pseuDo-Distilled Diffusion LLM) 🚀.

Current Diffusion Language Models (DLMs) have been studied at a smaller scale compared to their autoregressive (AR) counterparts and lack fair comparison on language modeling benchmarks. Additionally, training diffusion models from scratch at scale remains challenging. We propose adapting…

NeurIPS 2024 Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"

](https://huggingface.co/Dream-org/Dream-v0-Base-7B)

The repo contains source codes for ACL 2023 Findings paper DiffuSum: Generation Enhanced Extractive Summarization with Diffusion

🎈 Manuscript is under review since September 15, 2024.

MegaDLMs

Training Optimal Large Diffusion Language Models Jinjie Ni†, Qian Liu, Chao Du, Longxu Dou, Hang Yan, Zili Wang, Tianyu Pang, Michael Qizhe Shieh

Zhuowei Chen, Yuben Wu, Xinfeng Liao, Yujia Tian, Junyang Zhong, Lianxi Wang\

The implementation of the paper DiffusionRet: Generative Text-Video Retrieval with Diffusion Model.

This project is the official Codebase for DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space

The Flexibility Trap: Rethinking the Value of Arbitrary Order in Diffusion Language Models