1 个仓库
Awesome GitHub RepositoriesArbitrary Source Model Loaders
Abstractions for loading model files from files, memory, or other data sources without OS-specific APIs.
Distinct from Device Data Model Execution: Distinct from Device Data Model Execution: focuses on loading model data from arbitrary sources rather than executing operations on a device data model.
Explore 1 awesome GitHub repository matching data & databases · Arbitrary Source Model Loaders. Refine with filters or upvote what's useful.
Awesome Arbitrary Source Model Loaders GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- pytorch/executorch
pytorch/executorch
4,296在 GitHub 上查看ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Provides an abstraction to load model files from files, memory, or other data sources.
Pythondeep-learningembeddedgpu
