1 repo
Awesome GitHub RepositoriesMixture of Experts Optimizations
Specialized training techniques for managing adapter parameters in mixture-of-experts architectures.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Mixture of Experts Optimizations. Refine with filters or upvote what's useful.
Awesome Mixture of Experts Optimizations GitHub Repositories
We'll search the best matching repositories with AI.
- unslothai/unsloth
Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade
Splits adapter parameters in mixture-of-experts models to reduce memory overhead and increase training speed.
Pythonagentdeepseekdeepseek-r1
