How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
MergeKit is a toolkit for combining multiple pre-trained large language models into a single entity using algorithmic blending. It provides a specialized system for parameter interpolation and weight extraction to unify model capabilities. The project distinguishes itself through an evolutionary merge optimizer that tunes parameters based on quantitative evaluation metrics. It also features a mixture of experts orchestrator capable of converting dense models into sparse architectures and a tokenizer alignment tool for transplanting embeddings between different models. The toolkit covers a br
LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. Check out demo at https://huggingface.co/spaces/facebook/llm-transparency-tool-demo
This repo contains end-to-end recipes to pretrain and finetune the BERT (Bidirectional Encoder Representations from Transformers) language representation model using Azure Machine Learning service.
The main features of microsoft/azureml-bert are: Model Utilities.
Open-source alternatives to microsoft/azureml-bert include: arcee-ai/mergekit — MergeKit is a toolkit for combining multiple pre-trained large language models into a single entity using algorithmic… facebookresearch/llm-transparency-tool — LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of… guotong1988/bert-chinese. hanxiao/bert-as-service — This project is a high-performance BERT embedding service and inference server designed to map text sequences into… harishsg993010/llm-reasoner — Make any LLM to think deeper like OpenAI o1 and deepseek R1! algteam/bert-examples — BERT:google-BERT.