How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
LitGPT is a training and deployment framework for large language models, providing a suite of tools for pretraining, finetuning, quantizing, evaluating, and serving models within a production environment. It includes a dedicated training pipeline for adapting pretrained models to specific tasks, a quantization tool for reducing weight precision, and an inference server for hosting models via web interfaces. The framework supports high-performance model development through custom architecture implementation and the use of predefined recipes to standardize pretraining and finetuning. It enables
llm-foundry is a training framework for large language models, providing a system for foundation model pre-training and supervised fine-tuning. It includes a distributed trainer for scaling workloads across multiple nodes and GPUs, a dataset streaming pipeline for loading data from cloud storage, and a parameter-efficient fine-tuning implementation. The framework distinguishes itself through its use of parameter sharding and high-throughput data streaming to maintain stability during large-scale training. It incorporates low-rank adaptation to reduce computational costs and uses eight-bit flo
ERNIE is a development toolkit for training, fine-tuning, and deploying large language models built on the PaddlePaddle deep learning platform. It provides a comprehensive suite of core components, including an inference server for vision and language models, a training and fine-tuning toolkit, and a framework for building retrieval-augmented generation systems using private knowledge bases. The project features multimodal AI models capable of reasoning across text, images, and video to perform complex visual understanding and information extraction. It distinguishes itself through specialize
This project is a low-dependency engine designed for training large language models using native C and CUDA. It provides a bare-metal environment for tensor computation, allowing for the execution of neural network operations directly on hardware accelerators without the overhead of high-level software abstractions. The framework distinguishes itself by implementing manual gradient backpropagation and custom hardware-specific kernels, providing granular control over memory mapping and computational precision. It supports distributed training across multiple graphics processors and compute nod
TinyLlama is a compact 1.1B parameter language model pretrained on a dataset of 3 trillion tokens. It is an edge AI model designed for high-performance text generation on memory-constrained devices.
The main features of jzhang38/tinyllama are: Generative AI Models, Data-Parallel Training, Efficient LLM Development, LLM Development Toolkits, Large Language Model Training Frameworks, Model Pretraining Frameworks, Finetuning Workflows, Language Model Pretraining.
Open-source alternatives to jzhang38/tinyllama include: lightning-ai/litgpt — LitGPT is a training and deployment framework for large language models, providing a suite of tools for pretraining,… mosaicml/llm-foundry — llm-foundry is a training framework for large language models, providing a system for foundation model pre-training… paddlepaddle/ernie — ERNIE is a development toolkit for training, fine-tuning, and deploying large language models built on the… karpathy/llm.c — This project is a low-dependency engine designed for training large language models using native C and CUDA. It… deepseek-ai/deepseek-llm — DeepSeek-LLM is a large language model and causal language model designed for natural language generation. It… d2l-ai/d2l-en — This project is an educational platform and research toolkit designed to teach deep learning through a combination of…