# feifeibear/llmspeculativesampling

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/feifeibear-llmspeculativesampling).**

916 stars · 96 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/feifeibear/LLMSpeculativeSampling
- awesome-repositories: https://awesome-repositories.com/repository/feifeibear-llmspeculativesampling.md

## Description

Fast inference from large lauguage models via speculative decoding

## Tags

### Part of an Awesome List

- [Speculative Decoding](https://awesome-repositories.com/f/awesome-lists/ai/speculative-decoding.md) — Accelerates transformer inference via speculative drafting.