How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
WizardLM is a large language model and instruction-tuning framework designed to execute sophisticated coding, mathematical, and conversational tasks. It functions as an AI system for mathematical reasoning and code generation, as well as a synthetic dataset generator used to train other language models. The project is distinguished by its evolutionary instruction tuning, which uses a method to rewrite simple instructions into complex tasks. This process expands training dataset difficulty and produces a high volume of open-domain tasks across various difficulty levels. The system covers capa
LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
LMFlow is a comprehensive suite for large language model fine-tuning, context extension, multimodal processing, and inference execution. It provides a toolkit for updating model parameters through full tuning or memory-efficient adapter algorithms, alongside an inference engine for executing tuned models via command-line or web-based interfaces. The framework includes a dedicated alignment suite for supervised tuning and reward model training to refine model behavior. It features a context window extender to increase maximum input lengths and a multimodal framework for building chatbots that
This repo contains code and instructions for reproducing the experiments in the paper "RLCD: Reinforcement Learning from Contrast Distillation for Language Model Alignment" (https://arxiv.org/abs/2307.12950), by Kevin Yang, Dan Klein, Asli Celikyilmaz, Nanyun Peng, and Yuandong Tian. RLCD is a…
Dromedary: towards helpful, ethical and reliable LLMs.
The main features of ibm/dromedary are: Data Expansion, LLM Frameworks, Model Alignment and Feedback, Natural Language Processing, Research Implementations, Self-Improvement Methods.
Projects with overlapping indexed features include: mbzuai-nlp/lamini-lm — LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions. nlpxucan/wizardlm — WizardLM is a large language model and instruction-tuning framework designed to execute sophisticated coding,… optimalscale/lmflow — LMFlow is a comprehensive suite for large language model fine-tuning, context extension, multimodal processing, and… hiyouga/chatglm-efficient-tuning — ChatGLM-Efficient-Tuning is a fine-tuning framework and toolkit designed to optimize large language models using… facebookresearch/rlcd — This repo contains code and instructions for reproducing the experiments in the paper "RLCD: Reinforcement Learning… deep-diver/llm-as-chatbot — LLM as a Chatbot Service.