1 Repo
Awesome GitHub RepositoriesSpherical Linear Interpolations
Weight blending techniques that utilize spherical interpolation to preserve the magnitude of parameter vectors.
Distinct from Weight Interpolation: Specific mathematical approach to interpolation that maintains vector magnitude, distinct from generic linear blending
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Spherical Linear Interpolations. Refine with filters or upvote what's useful.
Awesome Spherical Linear Interpolations GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- arcee-ai/mergekit
arcee-ai/mergekit
7,156Auf GitHub ansehenMergeKit is a toolkit for combining multiple pre-trained large language models into a single entity using algorithmic blending. It provides a specialized system for parameter interpolation and weight extraction to unify model capabilities. The project distinguishes itself through an evolutionary merge optimizer that tunes parameters based on quantitative evaluation metrics. It also features a mixture of experts orchestrator capable of converting dense models into sparse architectures and a tokenizer alignment tool for transplanting embeddings between different models. The toolkit covers a br
Creates smooth transitions between models using spherical linear interpolation to maintain parameter magnitude.
Pythonllamallmmodel-merging
