How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
Toolkit for creating, sharing and using natural language prompts.
This repository provides an overview of all components used for the creation of BLOOMZ & mT0 and xP3 introduced in the paper Crosslingual Generalization through Multitask Finetuning. Link to 25min video on the paper by Samuel Albanie; Link to 4min video on the paper by Niklas Muennighoff.
Metaseq is a transformer sequence modeling toolkit designed for training, fine-tuning, and deploying sequence-to-sequence models using open pre-trained weights. It provides a comprehensive framework for large language model training, including dedicated tools for sequence dataset processing and a standalone inference server for generating text via API requests. The project features specialized utilities for model quantization to reduce parameter precision to eight bits, which lowers memory usage and increases inference speed. It also includes a checkpoint conversion pipeline to transform mode
This repository provides an overview of all components from the paper OctoPack: Instruction Tuning Code Large Language Models. Link to 5-min video on the paper presented by Niklas Muennighoff.
Official Code Repository for the paper Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks (NeurIPS 2023).
The main features of nardien/kard are: Instruction Tuning.
Open-source alternatives to nardien/kard include: bigscience-workshop/promptsource — Toolkit for creating, sharing and using natural language prompts. bigscience-workshop/xmtf — This repository provides an overview of all components used for the creation of BLOOMZ & mT0 and xP3 introduced in the… facebookresearch/metaseq — Metaseq is a transformer sequence modeling toolkit designed for training, fine-tuning, and deploying… google-research/flan — Original Flan (2021) | The Flan Collection (2022) | Flan 2021 Citation | License. google-research/text-to-text-transfer-transformer — This is a machine learning framework for treating diverse natural language processing tasks as a unified text-to-text… bigcode-project/octopack — This repository provides an overview of all components from the paper OctoPack: Instruction Tuning Code Large Language…