# nvidia/transformerengine

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/nvidia-transformerengine).**

3,396 stars · 750 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/NVIDIA/TransformerEngine
- Homepage: https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/index.html
- awesome-repositories: https://awesome-repositories.com/repository/nvidia-transformerengine.md

## Description

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

## Tags

### Part of an Awesome List

- [Model Training Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/model-training-frameworks.md) — Library for accelerating transformer training on NVIDIA hardware.