1 Repo
Awesome GitHub RepositoriesLLM Profiling Suites
Tools that generate operator delegation tables, memory profiles, and time profiles specifically for diagnosing exported large language models.
Distinct from Debugging and Profiling Tools: Distinct from Debugging and Profiling Tools: specifically targets LLM profiling with operator delegation tables and memory profiles, not general application debugging.
Explore 1 awesome GitHub repository matching part of an awesome list · LLM Profiling Suites. Refine with filters or upvote what's useful.
Awesome LLM Profiling Suites GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- pytorch/executorch
pytorch/executorch
4,296Auf GitHub ansehenExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Generates operator delegation tables, memory profiles, and time profiles to diagnose exported LLM performance.
Pythondeep-learningembeddedgpu
