1 repositorio
Awesome GitHub RepositoriesArbitrary Source Model Loaders
Abstractions for loading model files from files, memory, or other data sources without OS-specific APIs.
Distinct from Device Data Model Execution: Distinct from Device Data Model Execution: focuses on loading model data from arbitrary sources rather than executing operations on a device data model.
Explore 1 awesome GitHub repository matching data & databases · Arbitrary Source Model Loaders. Refine with filters or upvote what's useful.
Awesome Arbitrary Source Model Loaders GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- pytorch/executorch
pytorch/executorch
4,296Ver en GitHubExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Provides an abstraction to load model files from files, memory, or other data sources.
Pythondeep-learningembeddedgpu
