How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
This project is a transformer-based language model and autoregressive text generator designed to predict the next token in a sequence to produce human-like prose and synthetic text. It functions as a large language model that utilizes a transformer architecture to learn linguistic patterns from large datasets for unsupervised multitask learning. The repository provides a distribution of pre-trained weights, enabling natural language processing tasks without requiring additional training. This allows the model to perform zero-shot task generalization by applying learned patterns to new tasks.
A 13B large language model developed by Baichuan Intelligent Technology
Baichuan-7B is an open-source 7 billion parameter bilingual Transformer model designed for text generation and few-shot learning across Chinese and English. It is built on a large Transformer architecture trained on a bilingual corpus, enabling it to produce coherent text in both languages from a single model. The model incorporates several optimization techniques that distinguish it from standard large language models. It uses rotary position embeddings that can extrapolate to longer sequences than seen during training, allowing context extension beyond the original 4096-token training lengt
MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a comprehensive environment for executing, optimizing, and deploying neural network models directly on mobile and resource-constrained edge devices. The framework distinguishes itself through a robust model optimization toolkit that supports quantization, compression, and structural graph manipulation to minimize memory footprint and maximize execution speed. It features a modular architecture that abstracts hardware-specific backends, allowing models to run efficiently across diverse
Moved to here: https://github.com/lyogavin/airllm
The main features of lyogavin/anima are: Text LLM Models, Inference Frameworks.
Projects with overlapping indexed features include: openai/gpt-2 — This project is a transformer-based language model and autoregressive text generator designed to predict the next… baichuan-inc/baichuan-13b — A 13B large language model developed by Baichuan Intelligent Technology. baichuan-inc/baichuan-7b — Baichuan-7B is an open-source 7 billion parameter bilingual Transformer model designed for text generation and… baichuan-inc/baichuan2 — Baichuan2 is a collection of pre-trained large language models, including base and chat variants, designed for natural… bentoml/openllm — OpenLLM is a framework for deploying, managing, and scaling open-source large language models. alibaba/mnn — MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a…