Axolotl is a configuration-driven framework designed for the fine-tuning, evaluation, and quantization of large language models. It functions as a comprehensive orchestrator for distributed training, enabling users to manage complex workflows across multi-node and multi-GPU environments. By utilizing structured configuration files, the platform streamlines the setup of training parameters, dataset paths, and hardware distribution strategies. The project distinguishes itself through its support for diverse training methodologies, including full-parameter tuning, parameter-efficient adaptation,
Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a configurable training pipeline orchestrated through YAML recipes, with CLI overrides and component swapping, distributed training via FSDP2, memory optimizations, and parameter-efficient fine-tuning methods like LoRA, DoRA, and QLoRA. The library distinguishes itself through its YAML-driven configuration system that defines all training parameters and instantiates components from config files, with full CLI override capability for any field or component at launch time. It suppo
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin
This project is a fine-tuning framework and training pipeline designed to optimize and adapt large language and vision models. It provides a specialized toolkit for parameter-efficient tuning and supervised learning, serving as both a trainer for multimodal models and a deployment tool for serving fine-tuned models via high-performance inference engines. The framework focuses on reducing memory and compute requirements by updating a small subset of model parameters. It supports a wide range of adaptation strategies, including vision-language model training to align text, image, video, and aud
Este proyecto es un entrenador de modelos multimodales y una herramienta de ajuste fino (fine-tuning) de aprendizaje automático que proporciona un flujo de trabajo contenedorizado para adaptar modelos preentrenados a tareas específicas. Cuenta con una interfaz web sin código y un tablero para entrenar modelos de lenguaje de gran tamaño y otros conjuntos de datos de aprendizaje automático sin escribir código.
Las características principales de huggingface/autotrain-advanced son: Multimodal Model Trainers, No-Code Training Interfaces, Computer Vision Training, LLM Fine-Tuning, No-Code Fine-Tuning Interfaces, Language Model Fine-Tuning, Cloud GPU Orchestration, Remote Model Training Services.
Las alternativas de código abierto para huggingface/autotrain-advanced incluyen: axolotl-ai-cloud/axolotl — Axolotl is a configuration-driven framework designed for the fine-tuning, evaluation, and quantization of large… pytorch/torchtune — Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a… unslothai/unsloth — Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and… hiyouga/llama-efficient-tuning — This project is a fine-tuning framework and training pipeline designed to optimize and adapt large language and vision… ludwig-ai/ludwig — Ludwig is a multimodal machine learning platform and low-code framework designed for building, training, and deploying… h2oai/h2o-llmstudio — h2o-llmstudio is a language model training framework that provides a no-code graphical interface for fine-tuning large…