# nvidia/megatron-lm

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/nvidia-megatron-lm).**

16,731 stars · 4,091 forks · Python · NOASSERTION

## Links

- GitHub: https://github.com/NVIDIA/Megatron-LM
- Homepage: https://docs.nvidia.com/megatron-core/developer-guide/latest/get-started/quickstart.html
- awesome-repositories: https://awesome-repositories.com/repository/nvidia-megatron-lm.md

## Description

Ongoing research training transformer models at scale

## Tags

### Part of an Awesome List

- [Distributed Parallelism](https://awesome-repositories.com/f/awesome-lists/ai/distributed-parallelism.md) — Framework for model, tensor, and context parallelism.
- [Frontier Reasoning Models](https://awesome-repositories.com/f/awesome-lists/ai/frontier-reasoning-models.md) — Efficient reasoning model framework.
- [Language Model Development](https://awesome-repositories.com/f/awesome-lists/ai/language-model-development.md) — Optimized library for training large-scale language models.
- [Large Language Models](https://awesome-repositories.com/f/awesome-lists/ai/large-language-models.md) — Research-focused transformer training at scale.
- [Model Training](https://awesome-repositories.com/f/awesome-lists/ai/model-training.md) — Research-focused framework for training transformer models at scale.
- [Model Training Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/model-training-frameworks.md) — Research-focused library for training transformers at scale.
- [Transformer Implementations](https://awesome-repositories.com/f/awesome-lists/ai/transformer-implementations.md) — Research framework for training large-scale transformer language models.
- [Vision Language Models](https://awesome-repositories.com/f/awesome-lists/ai/vision-language-models.md) — Frontier-class multimodal models with flexible architectural configurations.