1 repo
Awesome GitHub RepositoriesHardware-Accelerated Compute Backends
Optimized kernels and execution strategies for mapping operations onto GPUs and specialized silicon.
Explore 1 awesome GitHub repository matching devops & infrastructure · Hardware-Accelerated Compute Backends. Refine with filters or upvote what's useful.
Awesome Hardware-Accelerated Compute Backends GitHub Repositories
We'll search the best matching repositories with AI.
- vllm-project/vllm
vLLM is a high-throughput inference engine designed for the efficient serving and execution of large language models. It functions as a production-ready distributed model server, providing standard API protocols for online serving while also supporting offline batch processing. The system is built to maximize token gen
Pythonamdblackwellcuda
