1 Repo
Awesome GitHub RepositoriesModel Program Loading
Mechanisms for loading serialized model programs and weights from disk or memory into an execution runtime.
Distinguishing note: No candidate covers the specific act of loading a serialized ML program into a runtime.
Explore 1 awesome GitHub repository matching programming languages & runtimes · Model Program Loading. Refine with filters or upvote what's useful.
Awesome Model Program Loading GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- pytorch/executorch
pytorch/executorch
4,296Auf GitHub ansehenExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Loads serialized model programs from files or data sources for execution on target devices.
Pythondeep-learningembeddedgpu
