# huggingface/nanotron

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/huggingface-nanotron).**

2,718 stars · 319 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/huggingface/nanotron
- awesome-repositories: https://awesome-repositories.com/repository/huggingface-nanotron.md

## Description

Minimalistic large language model 3D-parallelism training

## Tags

### Part of an Awesome List

- [LLM Development Tools](https://awesome-repositories.com/f/awesome-lists/ai/llm-development-tools.md) — Minimalistic codebase for training large language models.
- [Model Training](https://awesome-repositories.com/f/awesome-lists/ai/model-training.md) — Framework for 3D-parallelism training of large models.
- [Model Training Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/model-training-frameworks.md) — Minimalistic library for 3D-parallelism training.
- [Pre Training Models](https://awesome-repositories.com/f/awesome-lists/ai/pre-training-models.md) — Listed in the “Pre Training Models” section of the Llm Course awesome list.
- [Training and Orchestration](https://awesome-repositories.com/f/awesome-lists/devops/training-and-orchestration.md) — Distributed primitives for efficient large-scale model training.