1 مستودع
Awesome GitHub RepositoriesOptimization Techniques
Methods and algorithms for improving the memory and compute efficiency of neural network training and inference.
Distinguishing note: Focuses specifically on efficiency and acceleration techniques rather than general model architectures or training frameworks.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Optimization Techniques. Refine with filters or upvote what's useful.
Awesome Optimization Techniques GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- deepspeedai/deepspeed
deepspeedai/DeepSpeed
42,528عرض على GitHubDeepSpeed is a high-performance library designed to scale deep learning model training and inference across massive clusters of GPUs and compute nodes. It provides a comprehensive suite of tools for distributed training, enabling the execution of models that exceed the memory capacity of single devices through advanced parameter partitioning, pipeline-based model parallelism, and memory-efficient state offloading. The framework distinguishes itself through specialized communication-efficient optimizers and hardware-aware acceleration techniques. By utilizing gradient compression, quantization
A collection of memory and compute efficiency techniques designed to accelerate training and inference for large-scale neural networks.
Pythonbillion-parameterscompressiondata-parallelism
