1 Repo
Awesome GitHub RepositoriesLayer Optimization Patches
Optimizing Hugging Face transformer models by swapping standard layers for memory-efficient Triton kernels with a single function call.
Distinct from Hugging Face: Distinct from Hugging Face: focuses on runtime layer optimization via kernel patching, not model format conversion.
Explore 1 awesome GitHub repository matching devops & infrastructure · Layer Optimization Patches. Refine with filters or upvote what's useful.
Awesome Layer Optimization Patches GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- linkedin/liger-kernel
linkedin/Liger-Kernel
6,148Auf GitHub ansehenLiger-Kernel is a collection of pre-built fused Triton kernels and patching utilities designed to accelerate large language model training. It provides drop-in kernel replacements for common LLM operations such as RMSNorm, cross-entropy loss, and attention, enabling increased throughput and reduced memory usage while preserving bitwise-exact gradients. The project serves as a toolkit for composing custom model architectures from individual optimized kernels and for patching pre-existing models with minimal code changes. The project distinguishes itself through its ability to perform runtime m
Optimizes Hugging Face transformer models by swapping standard layers for memory-efficient Triton kernels with a single function call.
Pythonfinetuninggemma2hacktoberfest
