How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
LLaMA-Factory is a comprehensive suite for dataset preparation, model fine-tuning, memory optimization, and standardized API deployment. It provides a unified platform for the supervised and reward-based fine-tuning of large language models and vision-language models. The framework includes a specialized toolkit for training vision-language models and a model serving interface that deploys trained models through high-performance APIs. It utilizes precision tuning and quantization techniques to reduce the hardware requirements and memory footprint of large models. The system covers data pipel
LitGPT is a training and deployment framework for large language models, providing a suite of tools for pretraining, finetuning, quantizing, evaluating, and serving models within a production environment. It includes a dedicated training pipeline for adapting pretrained models to specific tasks, a quantization tool for reducing weight precision, and an inference server for hosting models via web interfaces. The framework supports high-performance model development through custom architecture implementation and the use of predefined recipes to standardize pretraining and finetuning. It enables
Minimalistic large language model 3D-parallelism training
FastChat is a training and serving platform for large language models that provides an integrated toolkit for fine-tuning, hosting, and benchmarking chatbots. It functions as an inference server capable of hosting multiple models and exposing them via a standardized API for chat applications. The platform distinguishes itself through a distributed model controller that manages worker nodes and routes requests across a hardware-agnostic inference layer supporting various accelerators. It includes a dedicated evaluation framework for assessing model quality using automated judges, multi-turn di
A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
The main features of rucaibox/llmbox are: Evaluation Frameworks, Fine-Tuning Frameworks, Language Model Development, Model Training.
Projects with overlapping indexed features include: hiyouga/llama-factory — LLaMA-Factory is a comprehensive suite for dataset preparation, model fine-tuning, memory optimization, and… ludwig-ai/ludwig — Ludwig is a multimodal machine learning platform and low-code framework designed for building, training, and deploying… lightning-ai/litgpt — LitGPT is a training and deployment framework for large language models, providing a suite of tools for pretraining,… huggingface/nanotron — Minimalistic large language model 3D-parallelism training. lm-sys/fastchat — FastChat is a training and serving platform for large language models that provides an integrated toolkit for… paddlepaddle/paddlenlp — PaddleNLP is a development library and toolkit for training, fine-tuning, and deploying large and small language…