1 مستودع
Awesome GitHub RepositoriesRuntime Kernel Swaps
Replacing standard Hugging Face model layers with optimized Triton kernels at runtime without modifying model source code.
Distinct from Hugging Face: Distinct from Hugging Face: focuses on runtime kernel replacement for optimization, not model format conversion.
Explore 1 awesome GitHub repository matching devops & infrastructure · Runtime Kernel Swaps. Refine with filters or upvote what's useful.
Awesome Runtime Kernel Swaps GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- linkedin/liger-kernel
linkedin/Liger-Kernel
6,148عرض على GitHubLiger-Kernel is a collection of pre-built fused Triton kernels and patching utilities designed to accelerate large language model training. It provides drop-in kernel replacements for common LLM operations such as RMSNorm, cross-entropy loss, and attention, enabling increased throughput and reduced memory usage while preserving bitwise-exact gradients. The project serves as a toolkit for composing custom model architectures from individual optimized kernels and for patching pre-existing models with minimal code changes. The project distinguishes itself through its ability to perform runtime m
Swaps standard Hugging Face model layers for optimized Triton kernels with a single function call, preserving exact computation.
Pythonfinetuninggemma2hacktoberfest
