OpenLMLab/MOSS

Features

• Conversational AI Platforms - Provides a complete platform for deploying large language models with multi-turn dialogue and web interfaces.
• Conversational Dialogue Systems - Provides a comprehensive platform for building and deploying interactive AI systems capable of complex multi-turn dialogue.
• Multi-turn Interaction Managers - Manages stateful multi-turn conversations that follow complex instructions while applying safety filters.
• External Tool Execution - Enables the model to execute external tools like search engines and calculators to augment responses.
• Fine-Tuning Toolkits - Includes a specialized toolkit for supervised conversational fine-tuning of pre-trained language models.
• Tool-Augmented Language Models - Connects large language models to external plugins and tools to perform tasks beyond static text generation.
• Tool Augmentations - Extends model capabilities beyond static training data by allowing active invocation of external functions and APIs.
• Quantized Model Deployments - Deploys large language models with reduced memory footprints using INT4 and INT8 quantization for efficient inference.
• Language Model Fine-Tuning - Implements specialized workflows for adapting pre-trained language models to conversational tasks using custom datasets.
• Quantized Inference Runtimes - Implements a quantized runtime using low-bit weight precision to reduce GPU memory usage during inference.
• Weight Quantization - Compresses model weights to INT4 or INT8 precision to significantly reduce GPU memory usage during inference.
• Supervised Fine-Tuning - Implements supervised fine-tuning methods to optimize pre-trained models for specific conversational tasks.
• Tool-Execution Loops - Orchestrates the request-response loop between model tool requests and the execution of external functions.
• General Purpose Models - Produces human-like responses for diverse tasks including coding, mathematical problem solving, and general conversation.
• Plugin-Based Agent Integrations - Integrates external plugins by generating tool calls to enhance the accuracy of AI responses.
• Chatbot Hosting Services - Offers network APIs and hosting capabilities to provide model responses to external applications while maintaining state.
• Conversational Session Management - Tracks unique session identifiers to maintain context and conversation history across multi-turn interactions.
• Stateful - Provides a REST-based API that uses unique identifiers to maintain conversation state across multiple interactions.
• RESTful APIs - Exposes language model functionality through a standardized RESTful HTTP interface for external client integration.
• Plugin-Based Architectures - Uses a modular plugin architecture to integrate search engines and calculators for expanding the model's knowledge base.
• Web Chat Interfaces - Provides a graphical web-based user interface for interacting with the conversational AI model.
• Conversational and Dialog Datasets - Conversational data labeled for usefulness, loyalty, and harmlessness.
• Foundation Models - Conversational language model supporting multiple plugins and tools.
• Language Models - A tool-augmented conversational model for research and dialogue.
• LLM Frameworks - Bilingual conversational model supporting plugins and multi-turn dialogue.
• Open Source Models - Offers a conversational model capable of running on consumer hardware.
• Specialized Domain Models - Research-oriented conversational model.
• Text LLM Models - Conversational model supporting plugins and multi-turn dialogue.

Star history