awesome-repositories.comBlog

© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com

MCP Blog Curated searches Sitemap Privacy Terms

Speculators | Awesome Repository

vllm-projectspeculators

0

View on GitHub↗

518 stars·104 forks·Python·Apache-2.0·0 viewsdocs.vllm.ai/projects/speculators↗

Speculators

Features

Inference Optimization - Library for implementing and evaluating speculative decoding algorithms.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM