1 Repo
Awesome GitHub RepositoriesRuntime Kernel Swaps
Replacing standard Hugging Face model layers with optimized Triton kernels at runtime without modifying model source code.
Distinct from Hugging Face: Distinct from Hugging Face: focuses on runtime kernel replacement for optimization, not model format conversion.
Explore 1 awesome GitHub repository matching devops & infrastructure · Runtime Kernel Swaps. Refine with filters or upvote what's useful.
Awesome Runtime Kernel Swaps GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- linkedin/liger-kernel
linkedin/Liger-Kernel
6,148Auf GitHub ansehenLiger-Kernel is a collection of pre-built fused Triton kernels and patching utilities designed to accelerate large language model training. It provides drop-in kernel replacements for common LLM operations such as RMSNorm, cross-entropy loss, and attention, enabling increased throughput and reduced memory usage while preserving bitwise-exact gradients. The project serves as a toolkit for composing custom model architectures from individual optimized kernels and for patching pre-existing models with minimal code changes. The project distinguishes itself through its ability to perform runtime m
Swaps standard Hugging Face model layers for optimized Triton kernels with a single function call, preserving exact computation.
Pythonfinetuninggemma2hacktoberfest
