1 dépôt
Awesome GitHub RepositoriesModel Program Loading
Mechanisms for loading serialized model programs and weights from disk or memory into an execution runtime.
Distinguishing note: No candidate covers the specific act of loading a serialized ML program into a runtime.
Explore 1 awesome GitHub repository matching programming languages & runtimes · Model Program Loading. Refine with filters or upvote what's useful.
Awesome Model Program Loading GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- pytorch/executorch
pytorch/executorch
4,296Voir sur GitHubExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Loads serialized model programs from files or data sources for execution on target devices.
Pythondeep-learningembeddedgpu
