# lhao499/ringattention

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/lhao499-ringattention).**

773 stars · 53 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/lhao499/RingAttention
- awesome-repositories: https://awesome-repositories.com/repository/lhao499-ringattention.md

## Description

Large Context Attention

## Tags

### Part of an Awesome List

- [Attention Optimization](https://awesome-repositories.com/f/awesome-lists/ai/attention-optimization.md) — Distributes long-context attention across multiple devices.
- [Distributed Parallelism](https://awesome-repositories.com/f/awesome-lists/ai/distributed-parallelism.md) — Blockwise parallel attention for near-infinite context windows.