# rulinshao/lightseq

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/rulinshao-lightseq).**

223 stars · 10 forks · Python

## Links

- GitHub: https://github.com/RulinShao/LightSeq
- awesome-repositories: https://awesome-repositories.com/repository/rulinshao-lightseq.md

## Description

Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training

## Tags

### Part of an Awesome List

- [Inference Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/inference-frameworks.md) — Sequence-level parallelism for distributed transformer inference.
- [Inference Serving Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-serving-engines.md) — Sequence-level parallelism for distributed transformer inference.