1 Repo
Compilation of model operations into optimized kernels for NVIDIA GPU architectures.
Distinct from NVIDIA GPU Kernels: Focuses on the compiler backend process for NVIDIA GPUs rather than just the kernels themselves
Explore 1 awesome GitHub repository matching artificial intelligence & ml · CUDA Backend Compilation. Refine with filters or upvote what's useful.
IREE is an MLIR-based compiler toolchain and runtime designed to translate machine learning models from various frameworks into optimized binaries for execution across diverse hardware targets. It provides a unified pipeline to ingest models from PyTorch, TensorFlow, JAX, and ONNX, lowering them into a common intermediate representation for deployment on CPUs, GPUs, and bare-metal embedded systems. The project distinguishes itself through a bytecode virtual machine and a hardware abstraction layer that decouple high-level model logic from specific hardware instruction sets. It supports sophis
Compiles models to target specific Nvidia GPU architectures using a dedicated CUDA backend.