Awesome GitHub RepositoriesGeneral Purpose Models

Llama is a large language model runtime and inference engine designed to load and execute autoregressive transformer models. It enables the generation of natural language text completions from prompts using pretrained weights. The system features multi-GPU model parallelism, which distributes model weights and workloads across multiple graphics processors to support larger parameter counts. It also incorporates a content safety filter that uses classifiers to intercept and block unsafe inputs or outputs during the inference process. The project covers broad capabilities in distributed model

Qwen is a comprehensive framework for large language model development, serving, and deployment. It provides a complete ecosystem for transformer-based sequence modeling, offering base models alongside specialized tools for instruction-tuned alignment, fine-tuning, and long-context inference. The project is designed to support both research and production environments, enabling users to train, optimize, and host generative models locally or across distributed hardware. The framework distinguishes itself through its focus on high-performance serving and extensibility. It features a high-perfor

ChatGLM3 is an open-weights large language model designed for bilingual conversational interactions in English and Chinese. It functions as a tool-augmented system capable of calling external functions and executing internal code to resolve complex tasks. The model utilizes four-bit quantization to reduce memory requirements, enabling inference on consumer hardware and diverse processing units including GPUs and CPUs. It features an expanded context window for processing and summarizing long documents and includes a supervised fine-tuning pipeline for adapting the model to specialized domains

InternLM is a large language model and a comprehensive suite of weights designed for text generation and complex reasoning. It functions as an inference engine for serving responses, a fine-tuning framework for adjusting model weights, and a platform for building autonomous AI agents. The system is capable of processing long-context input sequences up to one million tokens for document analysis. It employs chain-of-thought reasoning to solve knowledge-intensive tasks by generating intermediate logic steps before producing a final answer. The project covers model weight optimization through s

Baichuan2 este o colecție de modele de limbaj mari pre-antrenate, incluzând variante de bază și de chat, concepute pentru generarea de limbaj natural și AI conversațional multi-turn. Acesta oferă un motor de inferență și un framework de fine-tuning pentru a adapta aceste modele la seturi de date personalizate și domenii specializate. Proiectul dispune de un toolkit de cuantizare și un motor de inferență care permit execuția modelului pe diverse hardware-uri, inclusiv procesoare grafice (GPU), procesoare centrale (CPU) și acceleratoare specializate. Aceste instrumente suportă cuantizarea ponderilor pe biți puțini pentru a reduce utilizarea memoriei și a crește viteza de inferență pe hardware limitat. Sistemul acoperă o gamă largă de capabilități, inclusiv antrenarea distribuită pe mai multe mașini, fine-tuning eficient din punct de vedere al parametrilor și alinierea supervizată pentru interacțiunea umană. Include, de asemenea, utilitare pentru conversia versiunilor de model și oferă interfețe conversaționale prin instrumente de linie de comandă sau demonstrații bazate pe web.