This project is a transformer-based language model and autoregressive text generator designed to predict the next token in a sequence to produce human-like prose and synthetic text. It functions as a large language model that utilizes a transformer architecture to learn linguistic patterns from large datasets for unsupervised multitask learning. The repository provides a distribution of pre-trained weights, enabling natural language processing tasks without requiring additional training. This allows the model to perform zero-shot task generalization by applying learned patterns to new tasks.
Baichuan-7B is an open-source 7 billion parameter bilingual Transformer model designed for text generation and few-shot learning across Chinese and English. It is built on a large Transformer architecture trained on a bilingual corpus, enabling it to produce coherent text in both languages from a single model. The model incorporates several optimization techniques that distinguish it from standard large language models. It uses rotary position embeddings that can extrapolate to longer sequences than seen during training, allowing context extension beyond the original 4096-token training lengt
Baichuan2 is a collection of pre-trained large language models, including base and chat variants, designed for natural language generation and multi-turn conversational AI. It provides an inference engine and a fine-tuning framework to adapt these models to custom datasets and specialized domains. The project features a quantization toolkit and an inference engine that enable model execution across diverse hardware, including graphics processors, central processors, and specialized accelerators. These tools support low-bit weight quantization to reduce memory usage and increase inference spee
A 13B large language model developed by Baichuan Intelligent Technology
TuringMM 智娃AI大模型
The main features of lightyear-turing/turingmm-34b-chat are: Text LLM Models.
Open-source alternatives to lightyear-turing/turingmm-34b-chat include: openai/gpt-2 — This project is a transformer-based language model and autoregressive text generator designed to predict the next… baichuan-inc/baichuan-7b — Baichuan-7B is an open-source 7 billion parameter bilingual Transformer model designed for text generation and… baichuan-inc/baichuan2 — Baichuan2 is a collection of pre-trained large language models, including base and chat variants, designed for natural… blinkdl/chatrwkv — ChatRWKV is an open-source frontend and GPU-accelerated inference engine designed for interacting with RWKV recurrent… clue-ai/chatyuan — ChatYuan: Large Language Model for Dialogue in Chinese and English. baichuan-inc/baichuan-13b — A 13B large language model developed by Baichuan Intelligent Technology.