1 repository
Installable bundles containing specialized machine learning operations for cross-language integration.
Distinct from Python Packages: Distinct from general Python packages: focuses on bundling custom operator kernels for cross-language runtime support.
Explore 1 awesome GitHub repository matching development tools & productivity · Operator Packages. Refine with filters or upvote what's useful.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Bundles specialized machine learning operations into installable packages for Python, Java, and other environments.