awesome-repositories.com
Blog
MCP
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
hiyouga avatar

hiyouga/EasyR1

0
View on GitHub↗
verl.readthedocs.io↗

EasyR1

EasyR1 es un sistema de entrenamiento distribuido y framework de aprendizaje por refuerzo para modelos de lenguaje y visión-lenguaje de gran escala. Funciona como un entrenador multimodal y una implementación de un pipeline de Proximal Policy Optimization diseñado para refinar las capacidades de razonamiento y percepción de modelos que procesan tanto texto como imágenes.

El sistema se especializa en distribuir cargas de trabajo de aprendizaje por refuerzo a través de múltiples nodos de cómputo para gestionar altos requisitos de memoria. Optimiza el uso del hardware mediante entrenamiento sin padding y fine-tuning para ajustar modelos grandes en las unidades de procesamiento gráfico (GPU) disponibles.

El framework cubre el aprendizaje por refuerzo y la orquestación de modelos de recompensa, incluyendo flujos de trabajo de aprendizaje por refuerzo a partir de retroalimentación humana (RLHF). Su superficie técnica incluye paralelismo de datos distribuido, entrenamiento de precisión híbrida y pipelines de entrada multimodal para datos intercalados de texto e imagen.

El proyecto incluye utilidades para la recuperación de estado basada en checkpoints y se integra con herramientas de registro externas para rastrear el progreso del entrenamiento y las métricas de rendimiento.

Búsqueda con IA

Explora más repositorios increíbles

Describe lo que necesitas en lenguaje sencillo: la IA clasifica miles de proyectos open-source curados por relevancia.

Start searching with AI

Features

  • Multimodal Reinforcement Learning - Uses RL algorithms to refine the outputs of vision and language models through scalable training.
  • Data-Parallel Training - Synchronizes model gradients across multiple compute nodes to enable training of models exceeding single-node memory.
  • Distributed Training - Provides a framework for distributing large-model RL workloads across multiple compute nodes.
  • Multi-Node Training Scaling - Distributes large-scale model training across multiple hardware nodes to manage GPU resources and memory.
  • Multimodal Model Trainers - Implements a training pipeline designed to optimize reasoning and perception in multimodal vision-language models.
  • Multimodal Training Pipelines - Provides end-to-end workflows for processing interleaved text and image data streams for vision-language model training.
  • Distributed Training - Scales the training of large language models across multiple compute nodes to increase processing speed.
  • RL Post-Training - Offers a scalable system for RL post-training of large language and vision-language models.
  • Vision-Language Training - Runs reinforcement learning pipelines to improve reasoning and perception in models processing both text and images.
  • Reinforcement Learning Training Pipelines - Orchestrates scalable reinforcement learning pipelines to improve reasoning in multimodal models.
  • RLHF Training Pipelines - Coordinates the interaction between policy models, reward models, and value functions for iterative model refinement.
  • PPO Implementations - Provides a concrete implementation of Proximal Policy Optimization for refining generative multimodal models.
  • Checkpoint-Based Recovery - Implements mechanisms to save and restore model weights and optimizer states for training stability.
  • Sequence Packing - Packs variable-length sequences into single dense tensors to eliminate wasteful compute cycles during training.
  • Mixed Precision Training - Employs mixed-precision floating point formats to reduce graphics memory usage and accelerate training.
  • Large Model Optimizations - Reduces hardware requirements through padding-free training and fine-tuning to fit large models on available GPUs.
  • Reinforcement Learning Optimizers - Executes reinforcement learning algorithms using text and image datasets to refine model outputs.
  • Training Checkpointing - Saves training progress and state to ensure fault tolerance and the ability to resume training.
  • Training Memory Optimizers - Implements padding-free training and fine-tuning techniques to reduce graphics memory requirements for large-scale model training.
  • Reasoning Models - User-friendly framework for reasoning model training.
  • Reinforcement Learning Frameworks - Simplified training pipeline for reasoning-focused models.
5,034 estrellas·372 forks·Python·Apache-2.0·10 vistas

Historial de estrellas

Gráfico del historial de estrellas de hiyouga/easyr1Gráfico del historial de estrellas de hiyouga/easyr1

Alternativas open-source a EasyR1

Proyectos open-source similares, clasificados según cuántas características comparten con EasyR1.
  • internlm/xtunerAvatar de InternLM

    InternLM/xtuner

    5,150Ver en GitHub↗

    xtuner is a comprehensive training engine for large language models, offering a toolkit for pre-training, supervised fine-tuning, and the optimization of vision-language multimodal models. It serves as a distributed training accelerator and a specialized framework for scaling Mixture-of-Experts models and aligning model behavior through reinforcement learning from human feedback. The project distinguishes itself through advanced memory and compute optimizations, such as sequence parallelism for ultra-long context windows and interleaved pipeline parallelism to reduce GPU idle time. It provide

    Pythonagentdeepseek-v3gpt-oss
    Ver en GitHub↗5,150
  • zhaochenyang20/awesome-ml-sys-tutorialAvatar de zhaochenyang20

    zhaochenyang20/Awesome-ML-SYS-Tutorial

    5,371Ver en GitHub↗

    This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

    Python
    Ver en GitHub↗5,371
  • open-mmlab/mmagicAvatar de open-mmlab

    open-mmlab/mmagic

    7,434Ver en GitHub↗

    mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp

    Jupyter Notebookaigccomputer-visiondeep-learning
    Ver en GitHub↗7,434
  • mlfoundations/open_clipAvatar de mlfoundations

    mlfoundations/open_clip

    13,935Ver en GitHub↗

    Open CLIP is an open source framework for training and deploying Contrastive Language-Image Pre-training models. It serves as a vision-language training framework and multimodal embedding engine that maps images and text into a shared vector space for similarity searches and zero-shot classification. The project provides a toolkit for distributed training of contrastive models and includes an image-to-text generative model for producing natural language descriptions. It supports custom text encoder integration and utilizes teacher-student model distillation to transfer knowledge from large pr

    Pythoncomputer-visioncontrastive-lossdeep-learning
    Ver en GitHub↗13,935
Ver las 30 alternativas a EasyR1→

Preguntas frecuentes

¿Qué hace hiyouga/easyr1?

EasyR1 es un sistema de entrenamiento distribuido y framework de aprendizaje por refuerzo para modelos de lenguaje y visión-lenguaje de gran escala. Funciona como un entrenador multimodal y una implementación de un pipeline de Proximal Policy Optimization diseñado para refinar las capacidades de razonamiento y percepción de modelos que procesan tanto texto como imágenes.

¿Cuáles son las características principales de hiyouga/easyr1?

Las características principales de hiyouga/easyr1 son: Multimodal Reinforcement Learning, Data-Parallel Training, Distributed Training, Multi-Node Training Scaling, Multimodal Model Trainers, Multimodal Training Pipelines, RL Post-Training, Vision-Language Training.

¿Qué alternativas de código abierto existen para hiyouga/easyr1?

Las alternativas de código abierto para hiyouga/easyr1 incluyen: internlm/xtuner — xtuner is a comprehensive training engine for large language models, offering a toolkit for pre-training, supervised… zhaochenyang20/awesome-ml-sys-tutorial — This project provides a comprehensive technical guide and framework for engineering large-scale machine learning… open-mmlab/mmagic — mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and… mlfoundations/open_clip — Open CLIP is an open source framework for training and deploying Contrastive Language-Image Pre-training models. It… pytorch/torchtune — Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a… inclusionai/areal — AReaL is a system for agent orchestration, distributed model training, and parameter-efficient tuning. It provides a…