facebookresearch/metaseq

Features

• Decoder Models - Framework for training and evaluating large-scale language models.
• Instruction Tuning - Library for training and evaluating large-scale language models.
• Large Language Models - Codebase for working with open pre-trained transformer architectures.
• Open Source Models - Open pre-trained transformer language models for research.