Awesome GitHub RepositoriesPruning Ratio Optimization

Torch-Pruning is a deep learning model pruning tool and neural network optimization toolkit designed for PyTorch. The library analyzes neural network graphs to remove redundant parameters and channels, reducing model size and computational costs. The framework traces computational graphs dynamically using sample inputs to map relational dependencies and identify coupled layers that require simultaneous pruning. It evaluates and ranks layer parameters across the entire network using global importance ranking and applies structural constraints to optimize overall outcomes. Additional capabili

This project is a framework for aligning large language models with human preferences. It provides a library for optimizing model behavior by mapping preference data directly to a policy objective, bypassing the need for a separate reward model. The framework utilizes a closed-form mathematical objective to adjust model weights by maximizing the likelihood of preferred responses relative to dispreferred ones. It includes a toolkit for supervised fine-tuning, allowing users to establish a stable baseline on demonstration data before applying preference-based optimization techniques. The libra

PocketFlow is an integrated toolkit for deep learning model compression, distributed training, and mobile format optimization. It provides a system for reducing the size and complexity of neural networks to improve inference efficiency, featuring a dedicated engine for knowledge distillation and a mobile model optimizer. The framework differentiates itself through an automated hyperparameter tuning system that uses reinforcement learning and statistical models to determine optimal compression ratios and layer-wise bit allocation. It also includes a distributed training system that utilizes mu