# hao-ai-lab/lookaheaddecoding

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/hao-ai-lab-lookaheaddecoding).**

1,336 stars · 83 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/hao-ai-lab/LookaheadDecoding
- Homepage: https://arxiv.org/abs/2402.02057
- awesome-repositories: https://awesome-repositories.com/repository/hao-ai-lab-lookaheaddecoding.md

## Description

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

## Tags

### Part of an Awesome List

- [Speculative Decoding](https://awesome-repositories.com/f/awesome-lists/ai/speculative-decoding.md) — Breaks sequential dependencies to parallelize token generation.