1 repo
Methods for generating diverse training examples from seed data using language models.
Distinguishing note: Focuses on the generation of training data rather than the training process itself.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Dataset Synthesis. Refine with filters or upvote what's useful.
This project provides an end-to-end framework for adapting large language models to follow user instructions through supervised fine-tuning. It functions as a comprehensive training pipeline that enables the creation of specialized assistant models by minimizing the difference between predicted outputs and target responses within structured instruction datasets. The framework distinguishes itself by integrating synthetic data generation with memory-efficient training techniques. It utilizes powerful language models to iteratively expand small sets of human-written seeds into diverse, high-qua
Generates diverse task-based training pairs from a small set of human-written seed examples.