NVIDIAMegatron-LM

Megatron LM

Distributed Parallelism - Framework for model, tensor, and context parallelism.
Frontier Reasoning Models - Efficient reasoning model framework.
Language Model Development - Optimized library for training large-scale language models.
Large Language Models - Research-focused transformer training at scale.
Model Training - Research-focused framework for training transformer models at scale.

AI search

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Distributed Parallelism - Framework for model, tensor, and context parallelism.
Frontier Reasoning Models - Efficient reasoning model framework.
Language Model Development - Optimized library for training large-scale language models.
Large Language Models - Research-focused transformer training at scale.
Model Training - Research-focused framework for training transformer models at scale.

Model Training Frameworks - Research-focused library for training transformers at scale.

Transformer Implementations - Research framework for training large-scale transformer language models.

Vision Language Models - Frontier-class multimodal models with flexible architectural configurations.

Ongoing research training transformer models at scale