# vllm-project/speculators

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/vllm-project-speculators).**

518 stars · 104 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/vllm-project/speculators
- Homepage: https://docs.vllm.ai/projects/speculators
- awesome-repositories: https://awesome-repositories.com/repository/vllm-project-speculators.md

## Description

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

## Tags

### Part of an Awesome List

- [Inference Optimization](https://awesome-repositories.com/f/awesome-lists/ai/inference-optimization.md) — Library for implementing and evaluating speculative decoding algorithms.