awesome-repositories.com
© 2026 Bringes Technology SRL·VAT RO45896025·hello@bringes.io
MCPSitemapPrivacyTerms
Speculative Decoding Strategies · Awesome GitHub Repositories

1 repo

Awesome GitHub RepositoriesSpeculative Decoding Strategies

Techniques that predict multiple future tokens in parallel to accelerate the generation process.

Explore 1 awesome GitHub repository matching artificial intelligence & ml · Speculative Decoding Strategies. Refine with filters or upvote what's useful.

  1. Home
  2. Artificial Intelligence & ML
  3. Model Lifecycle Management
  4. Model Inference and Serving
  5. Inference Acceleration Techniques
  6. Speculative Decoding Strategies

Awesome Speculative Decoding Strategies GitHub Repositories

Describe the repository you're looking for…
We'll search the best matching repositories with AI.
  • unslothai/unsloth

    unslothai/unsloth

    52,461GitHubView on GitHub↗

    Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade

    Pythonagentdeepseekdeepseek-r1