2 Repos
Awesome GitHub RepositoriesDisk Size Reducers
Tools that convert model weights to lower-precision types during conversion to shrink file size while preserving accuracy.
Distinct from Model Quantization Frameworks: Distinct from Model Quantization Frameworks: focuses specifically on reducing on-disk file size, not general quantization frameworks.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Disk Size Reducers. Refine with filters or upvote what's useful.
Awesome Disk Size Reducers GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- opennmt/ctranslate2
OpenNMT/CTranslate2
4,319Auf GitHub ansehenCTranslate2 is a C++ inference engine and runtime for Transformer models, designed to execute models on both CPU and GPU with optimizations for speed and memory efficiency. It functions as a model format converter, quantization tool, and REST API server, enabling deployment of neural machine translation, automatic speech recognition, and text generation models. The engine distinguishes itself through a suite of runtime optimizations including layer fusion, weight-matrix quantization, batch-by-length grouping, and a caching allocator that reuses GPU memory. It supports tensor-parallel model di
Converts model weights to lower-precision types during conversion to shrink file size while preserving accuracy.
C++avxavx2cpp - pytorch/executorch
pytorch/executorch
4,296Auf GitHub ansehenExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,
Shrinks model file size through quantization-aware and post-training quantization for edge deployment.
Pythondeep-learningembeddedgpu
