# epfml/landmark-attention

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/epfml-landmark-attention).**

426 stars · 38 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/epfml/landmark-attention
- Homepage: https://arxiv.org/abs/2305.16300
- awesome-repositories: https://awesome-repositories.com/repository/epfml-landmark-attention.md

## Description

Landmark Attention: Random-Access Infinite Context Length for Transformers

## Tags

### Part of an Awesome List

- [Attention Optimization](https://awesome-repositories.com/f/awesome-lists/ai/attention-optimization.md) — Enables infinite context length via random-access attention.