Open-source alternatives to WebCPM

Production-Ready LLM Agent SDK for Every Developer

Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)

ChatALL is a multi-model chat client and productivity tool designed to evaluate the quality of answers from different large language models. It provides a unified interface for interacting with various AI chatbots across different service providers from a single window, allowing users to send a single prompt to multiple models simultaneously. The application enables side-by-side response comparison through a dynamic columnar layout and concurrent querying. It functions as a local chat history manager, using a privacy-focused storage system to keep prompt records and conversation history saved

Wenda is an LLM orchestration platform and custom workflow engine designed to manage multiple language model backends through a unified interface. It functions as a self-hosted AI gateway that enables the execution of complex task sequences and automated conversation flows. The system utilizes JavaScript plugins to orchestrate workflows and trigger external API calls. It supports retrieval augmented generation by injecting relevant data from vector stores and offline files into prompts to increase response accuracy. The platform is built for private network deployments, featuring multi-user

👋 欢迎来到 ChatGLM 创意世界！你可以使用修订和续写的功能来生成创意内容！

fastllm is a set of specialized software components for model weight conversion, Mixture-of-Experts runtimes, and tensor parallelism. It provides an OpenAI compatible API server to expose large language model capabilities through a standardized request format. The project features a tensor parallelism framework that splits computational workloads across multiple GPUs to accelerate execution. It includes a dedicated runtime optimized for Mixture-of-Experts architectures and a quantization tool to convert model weights into lower precision formats to reduce memory usage and increase throughput.