Why is vllm-project/vllm a recommended Cross-Platform AI Accelerators GitHub Repositories repository?

Optimizes generative model performance across diverse hardware architectures, including specialized GPUs and consumer-grade silicon.

Why is zsdonghao/tensorlayer a recommended Cross-Platform AI Accelerators GitHub Repositories repository?

Acts as a cross-platform library enabling deep learning models to run efficiently on various GPUs and AI accelerators.

2 repository-uri

Awesome GitHub RepositoriesCross-Platform AI Accelerators

Optimizations that enable generative models to run efficiently across various hardware architectures.

Explore 2 awesome GitHub repositories matching operating systems & systems programming · Cross-Platform AI Accelerators. Refine with filters or upvote what's useful.

Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.

vllm-project/vllm
vllm-project/vllm
83,048Vezi pe GitHub
vLLM is a high-throughput inference engine designed for the efficient serving and execution of large language models. It functions as a production-ready distributed model server, providing standard API protocols for online serving while also supporting offline batch processing. The system is built to maximize token generation speed and memory efficiency, enabling both large-scale cloud deployments and local execution on personal hardware. The project distinguishes itself through advanced memory management and request scheduling techniques, most notably its use of non-contiguous key-value cach
Optimizes generative model performance across diverse hardware architectures, including specialized GPUs and consumer-grade silicon.
Pythonamdblackwellcuda
Vezi pe GitHub83,048
zsdonghao/tensorlayer
zsdonghao/tensorlayer
7,384Vezi pe GitHub
Tensorlayer is a deep learning framework and cross-backend AI library used to construct and execute neural network models. It serves as a scientific neural network toolkit providing customizable layers and architectures designed for research applications in science and engineering. The library enables multi-backend model execution, allowing the same model code to run across different deep learning frameworks, GPUs, and specialized AI accelerators. It includes a reinforcement learning library that provides both low-level and high-level tools for developing intelligent agents.
Acts as a cross-platform library enabling deep learning models to run efficiently on various GPUs and AI accelerators.
Python
Vezi pe GitHub7,384