1 Repo
Tools for replacing default library implementations with custom builds to enable specialized hardware or optimization providers.
Distinct from Runtime Libraries: Distinct from general runtime libraries: focuses on the ability to swap binary implementations at runtime for hardware-specific optimization.
Explore 1 awesome GitHub repository matching operating systems & systems programming · Binary Swapping Utilities. Refine with filters or upvote what's useful.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Enables the replacement of default library implementations with custom builds to support specific hardware execution providers.