Awesome GitHub RepositoriesGeneral Purpose Models

Llama is a large language model runtime and inference engine designed to load and execute autoregressive transformer models. It enables the generation of natural language text completions from prompts using pretrained weights. The system features multi-GPU model parallelism, which distributes model weights and workloads across multiple graphics processors to support larger parameter counts. It also incorporates a content safety filter that uses classifiers to intercept and block unsafe inputs or outputs during the inference process. The project covers broad capabilities in distributed model

Qwen is a comprehensive framework for large language model development, serving, and deployment. It provides a complete ecosystem for transformer-based sequence modeling, offering base models alongside specialized tools for instruction-tuned alignment, fine-tuning, and long-context inference. The project is designed to support both research and production environments, enabling users to train, optimize, and host generative models locally or across distributed hardware. The framework distinguishes itself through its focus on high-performance serving and extensibility. It features a high-perfor

ChatGLM3 is an open-weights large language model designed for bilingual conversational interactions in English and Chinese. It functions as a tool-augmented system capable of calling external functions and executing internal code to resolve complex tasks. The model utilizes four-bit quantization to reduce memory requirements, enabling inference on consumer hardware and diverse processing units including GPUs and CPUs. It features an expanded context window for processing and summarizing long documents and includes a supervised fine-tuning pipeline for adapting the model to specialized domains

InternLM is a large language model and a comprehensive suite of weights designed for text generation and complex reasoning. It functions as an inference engine for serving responses, a fine-tuning framework for adjusting model weights, and a platform for building autonomous AI agents. The system is capable of processing long-context input sequences up to one million tokens for document analysis. It employs chain-of-thought reasoning to solve knowledge-intensive tasks by generating intermediate logic steps before producing a final answer. The project covers model weight optimization through s

Baichuan2 est une collection de grands modèles de langage pré-entraînés, incluant des variantes de base et de chat, conçus pour la génération de langage naturel et l'IA conversationnelle multi-tours. Il fournit un moteur d'inférence et un framework de fine-tuning pour adapter ces modèles à des jeux de données personnalisés et à des domaines spécialisés. Le projet propose une boîte à outils de quantification et un moteur d'inférence qui permettent l'exécution du modèle sur divers matériels, y compris les processeurs graphiques (GPU), les processeurs centraux (CPU) et des accélérateurs spécialisés. Ces outils prennent en charge la quantification des poids en faible bit pour réduire l'utilisation de la mémoire et augmenter la vitesse d'inférence sur du matériel contraint. Le système couvre un large éventail de capacités, notamment l'entraînement distribué multi-machine, le fine-tuning efficace en paramètres et l'alignement supervisé pour l'interaction humaine. Il inclut également des utilitaires pour la conversion de version de modèle et fournit des interfaces conversationnelles via des outils en ligne de commande ou des démonstrations web.