How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
This project is an instruction tuning framework and synthetic data generator that uses high-capacity teacher models to produce instruction-following pairs for training smaller student models. It provides datasets and tools for supervised instruction tuning and reinforcement learning from human feedback. The framework specializes in cross-lingual tuning, offering high-quality instruction-following examples in English and Chinese to improve model generalization across different scripts. It includes a reward modeling tool for creating preference datasets and comparative ratings used to train rew
BELLE is a specialized implementation of Chinese conversational large language models, encompassing a full instruction tuning framework. It provides a pipeline for training, evaluating, and deploying models optimized for natural language understanding and dialogue tasks in the Chinese language. The project is distinguished by its integrated approach to model refinement, combining the curation of multi-million entry instruction datasets with a distributed training pipeline. This pipeline supports both full fine-tuning and low-rank adaptation to optimize conversational performance. The system
This repository contains the Unnatural Instructions dataset. Unnatural Instructions is a dataset of instructions automatically generated by a Large Language model. See full details in the paper: "Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor"
Alpaca dataset from Stanford, cleaned and curated
ChatAlpaca is a chat dataset that aims to help researchers develop models for instruction-following in multi-turn conversations. The dataset is an extension of the Stanford Alpaca data, which contains multi-turn instructions and their corresponding responses.
The main features of cascip/chatalpaca are: Instruction Tuning Datasets.
Projects with overlapping indexed features include: gururise/alpacadatacleaned — Alpaca dataset from Stanford, cleaned and curated. instruction-tuning-with-gpt-4/gpt-4-llm — This project is an instruction tuning framework and synthetic data generator that uses high-capacity teacher models to… lianjiatech/belle — BELLE is a specialized implementation of Chinese conversational large language models, encompassing a full instruction… orhonovich/unnatural-instructions — This repository contains the Unnatural Instructions dataset. Unnatural Instructions is a dataset of instructions… pku-alignment/safe-rlhf — Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback. project-baize/baize-chatbot — Let ChatGPT teach your own chatbot in hours with a single GPU!