awesome-repositories.com
© 2026 Bringes Technology SRL·VAT RO45896025·hello@bringes.io
MCPSitemapPrivacyTerms
Quantization Plugin Interfaces · Awesome GitHub Repositories

1 repo

Awesome GitHub RepositoriesQuantization Plugin Interfaces

Extensible interfaces that allow developers to register custom quantization methods.

Explore 1 awesome GitHub repository matching artificial intelligence & ml · Quantization Plugin Interfaces. Refine with filters or upvote what's useful.

  1. Home
  2. Artificial Intelligence & ML
  3. Model Lifecycle Management
  4. Model Optimization
  5. Quantization Plugin Interfaces

Awesome Quantization Plugin Interfaces GitHub Repositories

Describe the repository you're looking for…
We'll search the best matching repositories with AI.
  • vllm-project/vllm

    vllm-project/vllm

    70,745GitHubView on GitHub↗

    vLLM is a high-throughput inference engine designed for the efficient serving and execution of large language models. It functions as a production-ready distributed model server, providing standard API protocols for online serving while also supporting offline batch processing. The system is built to maximize token gen

    Pythonamdblackwellcuda