awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
ML-GSAI avatar

ML-GSAI/LLaDA

0
View on GitHub↗
3,580 stars·240 forks·Python·mit·14 views

LLaDA

LLaDA is a masked diffusion language model and conditional text generator. It generates text by iteratively refining masked tokens through a diffusion process rather than predicting the next token in a sequence.

The project functions as a vision-language diffusion model, converting visual inputs into text responses. It also serves as a preference optimization framework that uses log-likelihood estimation and evidence lower bounds to tune model responses.

The system supports multi-round conversational AI and text sequence evaluation. It integrates vision-language embedding for cross-modal conditioning and uses iterative token refinement to produce text.

Features

  • Masked Text Diffusion - Implements a masked diffusion architecture that iteratively refines tokens into final text.
  • Multimodal Diffusion Models - A system that converts visual inputs into text responses using a diffusion process for complex multimodal tasks.
  • Vision-Language Cross-Attention Fusions - Fuses visual encoder features with text embeddings to enable image-conditioned text generation.
  • Cross-Attention Conditioning - Implements cross-attention mechanisms to inject visual and textual context into the diffusion denoising process.
  • Iterative Refinement Generation - Generates text by repeatedly updating and refining masked sequences until convergence.
  • Vision-Language Models - Integrates visual and linguistic processing to describe images and answer questions.
  • Diffusion Masked Language Models - Generates text by iteratively refining masked tokens via a diffusion process.
  • Preference Optimization - Refines model responses based on human preferences using log-likelihood and evidence lower bounds.
  • Visual-to-Text Generation - Converts visual inputs into text responses using a diffusion process for multimodal tasks.
  • Discrete Diffusion Models - Utilizes a discrete state space and categorical distributions for token transitions during diffusion.
  • Variational Lower Bound Estimations - Calculates likelihoods via a variational lower bound to optimize model responses for specific preferences.
  • Conditional Masked Generators - Produces conditional text sequences by iteratively filling in missing tokens through masking.
  • Sequence Likelihood Estimators - Calculates probability estimates of sequences using evidence lower bounds for preference optimization.
  • Sequence Likelihood Scores - Measures the log-likelihood of text sequences to evaluate model predictive accuracy.
  • Language Diffusion Models - Large language diffusion models for text generation.

Star history

Star history chart for ml-gsai/lladaStar history chart for ml-gsai/llada

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Projects sharing features with LLaDA

These projects share indexed features with LLaDA. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • ailab-cvc/yolo-worldAILab-CVC avatar

    AILab-CVC/YOLO-World

    6,425View on GitHub↗

    YOLO-World is a vision-language framework and open-vocabulary object detection model. It identifies objects in images and video based on free-form text prompts without requiring predefined category labels. The system enables the identification of arbitrary objects by fusing image features with text embeddings. It includes a specialized tool for automated image labeling, which generates bounding box annotations for custom datasets using text-based prompts. The project provides a deployment pipeline for converting models into quantized ONNX and TFLite formats, supporting real-time inference on

    Python
    View on GitHub↗6,425
  • opengvlab/internvlOpenGVLab avatar

    OpenGVLab/InternVL

    10,061View on GitHub↗

    InternVL is a vision-language model framework that fuses a visual encoder with a large language model to translate image features into textual tokens for reasoning. It provides a system for multimodal inference and dialogue, enabling the processing of images and text to answer questions or generate descriptions. The project is distinguished by its high-resolution image processing, which uses dynamic tiling to maintain detail for images up to 4K resolution, and its chain-of-thought visual reasoning for solving complex mathematical and spatial problems. It also supports temporal frame sampling

    Pythongptgpt-4ogpt-4v
    View on GitHub↗10,061
  • datawhalechina/hello-agentsdatawhalechina avatar

    datawhalechina/hello-agents

    59,685View on GitHub↗

    This project provides a comprehensive framework for building, training, and managing autonomous agents. It enables the construction of systems that utilize language models to plan, manage memory, and execute multi-step tasks through iterative reasoning loops and tool-based actions. The framework distinguishes itself by offering specialized capabilities for interacting with graphical user interfaces and legacy software, allowing agents to perceive visual elements and perform actions like a human user. It supports complex, cross-application workflows through graph-based orchestration and provid

    Pythonagentllmrag
    View on GitHub↗59,685
  • openrlhf/openrlhfOpenRLHF avatar

    OpenRLHF/OpenRLHF

    9,675View on GitHub↗

    OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across distributed GPU clusters. It provides tools for aligning large language models and multimodal vision-language models using algorithms such as PPO, GRPO, and DPO. The framework distinguishes itself through a distributed inference engine that overlaps sample rollout with training to increase throughput. It supports scaling to models exceeding 70 billion parameters via parameter sharding and handles long-context sequences through ring-attention sequence parallelism. The project

    Pythonlarge-language-modelsopenai-o1proximal-policy-optimization
    View on GitHub↗9,675
Compare all 30 related projects→

Frequently asked questions

What does ml-gsai/llada do?

LLaDA is a masked diffusion language model and conditional text generator. It generates text by iteratively refining masked tokens through a diffusion process rather than predicting the next token in a sequence.

What are the main features of ml-gsai/llada?

The main features of ml-gsai/llada are: Masked Text Diffusion, Multimodal Diffusion Models, Vision-Language Cross-Attention Fusions, Cross-Attention Conditioning, Iterative Refinement Generation, Vision-Language Models, Diffusion Masked Language Models, Preference Optimization.

Which projects share features with ml-gsai/llada?

Projects with overlapping indexed features include: ailab-cvc/yolo-world — YOLO-World is a vision-language framework and open-vocabulary object detection model. It identifies objects in images… opengvlab/internvl — InternVL is a vision-language model framework that fuses a visual encoder with a large language model to translate… datawhalechina/hello-agents — This project provides a comprehensive framework for building, training, and managing autonomous agents. It enables the… openrlhf/openrlhf — OpenRLHF is a training framework and alignment library designed for reinforcement learning from human feedback across… kuleshov-group/mdlm — By Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T Chiu, Alexander Rush,… louaaron/score-entropy-discrete-diffusion — This repo contains a PyTorch implementation for the paper Discrete Diffusion Modeling by Estimating the Ratios of the…