1 repository
Awesome GitHub RepositoriesAsynchronous Layer Execution
Techniques for executing neural network layers using non-blocking streams to improve hardware throughput.
Distinguishing note: None of the candidates cover low-level GPU stream synchronization for neural network layers.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Asynchronous Layer Execution. Refine with filters or upvote what's useful.
Awesome Asynchronous Layer Execution GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- wang-xinyu/tensorrtx
wang-xinyu/tensorrtx
7,802Vezi pe GitHubtensorrtx is a computer vision inference engine and model implementation library designed for graphics processor acceleration. It provides a framework for optimizing deep learning models through a GPU inference optimizer, a deep learning model converter for transforming weights from frameworks like TensorFlow and PyTorch, and a custom plugin library to implement operations not natively supported by the TensorRT API. The project distinguishes itself through a comprehensive collection of pre-defined network implementations, ranging from various YOLO versions and DETR transformers for object det
Executes specialized network layers using non-blocking streams to prevent processor synchronization and increase throughput.
C++arcfacecrnndetr
