# deepseek-ai/dualpipe

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/deepseek-ai-dualpipe).**

2,967 stars · 326 forks · Python · MIT

## Links

- GitHub: https://github.com/deepseek-ai/DualPipe
- awesome-repositories: https://awesome-repositories.com/repository/deepseek-ai-dualpipe.md

## Description

A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.

## Tags

### Part of an Awesome List

- [Attention Optimization](https://awesome-repositories.com/f/awesome-lists/ai/attention-optimization.md) — Pipeline parallelism optimization for deep learning models.