# bytedance/bytetransformer

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bytedance-bytetransformer).**

479 stars · 36 forks · C++ · Apache-2.0

## Links

- GitHub: https://github.com/bytedance/ByteTransformer
- awesome-repositories: https://awesome-repositories.com/repository/bytedance-bytetransformer.md

## Description

optimized BERT transformer inference on NVIDIA GPU.  https://arxiv.org/abs/2210.03052

## Tags

### Part of an Awesome List

- [Multimodal Inference](https://awesome-repositories.com/f/awesome-lists/ai/multimodal-inference.md) — High-performance transformer implementation optimized for variable-length input sequences.