How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
ChatGLM-Efficient-Tuning is a fine-tuning framework and toolkit designed to optimize large language models using parameter-efficient fine-tuning techniques. It provides a pipeline for adjusting model behavior and reducing the memory and compute requirements necessary for training. The project features a web-based trainer and orchestration interface for configuring and executing the fine-tuning process on a single GPU. It supports quantized training in lower precision formats to enable fine-tuning on hardware with limited memory, as well as reinforcement learning from human feedback for model
Dromedary: towards helpful, ethical and reliable LLMs.
Panda项目是于2023年5月启动的开源海外中文大语言模型项目,致力于大模型时代探索整个技术栈,旨在推动中文自然语言处理领域的创新和合作。
Lit-llama is a PyTorch-based implementation framework for the LLaMA language model, providing a system for pre-training, fine-tuning, and high-performance inference. It includes a pre-training pipeline for creating foundational language models from scratch and tools for running pretrained weights to generate natural text and predict sequences. The project provides specialized toolkits for parameter-efficient fine-tuning using low-rank adaptation and lightweight adapters. It also includes a quantization library that reduces model memory footprints through four-bit and eight-bit precision to en
LLM as a Chatbot Service
The main features of deep-diver/llm-as-chatbot are: Chat Interfaces, LLM Frameworks, Natural Language Processing.
Projects with overlapping indexed features include: ibm/dromedary — Dromedary: towards helpful, ethical and reliable LLMs. mbzuai-nlp/lamini-lm — LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions. dandelionsllm/pandallm — Panda项目是于2023年5月启动的开源海外中文大语言模型项目,致力于大模型时代探索整个技术栈,旨在推动中文自然语言处理领域的创新和合作。. hiyouga/chatglm-efficient-tuning — ChatGLM-Efficient-Tuning is a fine-tuning framework and toolkit designed to optimize large language models using… lightning-ai/lit-llama — Lit-llama is a PyTorch-based implementation framework for the LLaMA language model, providing a system for… nlpxucan/wizardlm — WizardLM is a large language model and instruction-tuning framework designed to execute sophisticated coding,…