How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
This project is an instruction tuning framework and synthetic data generator that uses high-capacity teacher models to produce instruction-following pairs for training smaller student models. It provides datasets and tools for supervised instruction tuning and reinforcement learning from human feedback. The framework specializes in cross-lingual tuning, offering high-quality instruction-following examples in English and Chinese to improve model generalization across different scripts. It includes a reward modeling tool for creating preference datasets and comparative ratings used to train rew
BELLE is a specialized implementation of Chinese conversational large language models, encompassing a full instruction tuning framework. It provides a pipeline for training, evaluating, and deploying models optimized for natural language understanding and dialogue tasks in the Chinese language. The project is distinguished by its integrated approach to model refinement, combining the curation of multi-million entry instruction datasets with a distributed training pipeline. This pipeline supports both full fine-tuning and low-rank adaptation to optimize conversational performance. The system
The Largest-scale Chinese Medical QA Dataset： with 26,000,000 question answer pairs.
The main features of freedomintelligence/huatuo-26m are: Instruction Datasets, Medical Text Datasets.
Projects with overlapping indexed features include: cluebenchmark/pclue. da-southampton/redgpt — [English Version]. instruction-tuning-with-gpt-4/gpt-4-llm — This project is an instruction tuning framework and synthetic data generator that uses high-capacity teacher models to… lianjiatech/belle — BELLE is a specialized implementation of Chinese conversational large language models, encompassing a full instruction… phoebussi/alpaca-cot — We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods… plexpt/chatgpt-corpus — This project provides a comprehensive Chinese language corpus designed to support the training and fine-tuning of…
