1 Repo
Techniques for executing neural network layers using non-blocking streams to improve hardware throughput.
Distinguishing note: None of the candidates cover low-level GPU stream synchronization for neural network layers.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Asynchronous Layer Execution. Refine with filters or upvote what's useful.
tensorrtx is a computer vision inference engine and model implementation library designed for graphics processor acceleration. It provides a framework for optimizing deep learning models through a GPU inference optimizer, a deep learning model converter for transforming weights from frameworks like TensorFlow and PyTorch, and a custom plugin library to implement operations not natively supported by the TensorRT API. The project distinguishes itself through a comprehensive collection of pre-defined network implementations, ranging from various YOLO versions and DETR transformers for object det
Executes specialized network layers using non-blocking streams to prevent processor synchronization and increase throughput.