1 repository
Awesome GitHub RepositoriesModel Layer Patching
Runtime replacement of specific neural network layers with optimized implementations without source code changes.
Distinct from Runtime Method Patching: Distinct from Runtime Method Patching: targets ML model layers specifically, not general application methods.
Explore 1 awesome GitHub repository matching testing & quality assurance · Model Layer Patching. Refine with filters or upvote what's useful.
Awesome Model Layer Patching GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- linkedin/liger-kernel
linkedin/Liger-Kernel
6,148Vezi pe GitHubLiger-Kernel is a collection of pre-built fused Triton kernels and patching utilities designed to accelerate large language model training. It provides drop-in kernel replacements for common LLM operations such as RMSNorm, cross-entropy loss, and attention, enabling increased throughput and reduced memory usage while preserving bitwise-exact gradients. The project serves as a toolkit for composing custom model architectures from individual optimized kernels and for patching pre-existing models with minimal code changes. The project distinguishes itself through its ability to perform runtime m
Enables runtime monkey-patching of Hugging Face and Megatron-LM model layers with optimized Triton kernels.
Pythonfinetuninggemma2hacktoberfest
