Awesome GitHub RepositoriesTraining Data Pipelines

LLaMA-Factory is a comprehensive suite for dataset preparation, model fine-tuning, memory optimization, and standardized API deployment. It provides a unified platform for the supervised and reward-based fine-tuning of large language models and vision-language models. The framework includes a specialized toolkit for training vision-language models and a model serving interface that deploys trained models through high-performance APIs. It utilizes precision tuning and quantization techniques to reduce the hardware requirements and memory footprint of large models. The system covers data pipel

Keras is a high-level deep learning framework designed for constructing and training neural networks through the composition of modular, functional layers. It serves as a comprehensive modeling toolkit that provides standardized procedures for defining, evaluating, and deploying complex architectures. By utilizing a directed acyclic graph approach, the framework allows users to build intricate models with multiple inputs, outputs, and shared layers, ensuring consistent numerical execution through functional state management. The project distinguishes itself as a multi-backend machine learning

This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

Label Studio ist ein Tool für die Annotation verschiedener Datentypen und ein Arbeitsbereich für Datenannotation, der entwickelt wurde, um Datensätze für das Training von maschinellem Lernen vorzubereiten. Es fungiert als cloud-integrierte Daten-Pipeline, die Rohdaten aus Speichern importiert, den Annotationsprozess verwaltet und Labels in standardisierte Formate exportiert. Die Plattform verfügt über ein Framework zur Integration von Modellen für maschinelles Lernen, das eine Verbindung zu externen Modellservern herstellt. Dies ermöglicht modellgestützte Annotation und aktives Lernen, wodurch das System Vor-Labeling durchführen und Vorhersagen basierend auf menschlichem Feedback verfeinern kann. Die Software bietet Projektmanagement-Tools zur Organisation von Datensätzen und zur Zuweisung von Aufgaben an Benutzer über rollenbasierte Zugriffe. Sie unterstützt verschiedene Datentypen und nutzt speicherunabhängige Speicheradapter, um eine Verbindung zu lokalen Dateisystemen oder Cloud-Speicheranbietern herzustellen. Die Anwendung kann durch manuelle Einrichtung oder One-Click-Deployments auf Cloud-Infrastruktur installiert werden.

This project is a comprehensive educational resource and technical documentation suite for learning and developing deep learning models. It serves as an open-source textbook, implementation manual, and framework tutorial designed to guide users through the mathematical foundations and practical application of neural networks. The resource provides detailed instructional content on building various model architectures, including convolutional and recurrent neural networks. It includes a dedicated distributed training guide and a learning path that covers the fundamentals of tensors, automatic

This project is a deep learning framework designed for constructing, training, and deploying neural networks across diverse hardware environments. It functions as a high-performance tensor computation library that provides both imperative and symbolic programming interfaces, allowing developers to balance flexible, step-by-step model building with the efficiency of compiled computation graphs. The framework distinguishes itself through a hybrid execution engine that integrates declarative graph compilation with imperative runtime logic. It supports scalable, distributed training across multip

NeMo is a comprehensive framework designed for the development, training, and deployment of large-scale conversational and generative artificial intelligence models. It provides an integrated platform for building multimodal systems, encompassing speech processing, language modeling, and reinforcement learning alignment. The framework is built to handle the entire lifecycle of AI development, from data curation and model pretraining to production-ready service deployment. The platform distinguishes itself through advanced distributed training capabilities, including tensor and pipeline parall

Screenpipe is a local-first platform designed to record, index, and analyze desktop activity. By capturing screen, audio, and keyboard input, it creates a comprehensive and searchable history of computer usage. The system functions as an activity recorder and automation framework, providing a persistent, context-aware memory that allows artificial intelligence agents to observe and interact with local desktop environments. The platform distinguishes itself through a privacy-focused architecture that processes all data locally. It utilizes on-device computer vision and speech recognition to tr

Swift is a toolkit for the full-parameter and parameter-efficient fine-tuning of large language and multimodal models. It functions as a multimodal model trainer for text, image, video, and audio data, and includes specialized tools for model compression and reinforcement learning from human feedback. The framework provides an alignment toolkit for optimizing model behavior using preference learning algorithms and reinforcement learning. It integrates parameter-efficient fine-tuning methods to adapt models with minimal memory and compute requirements, alongside utilities for reducing hardware

MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a comprehensive environment for executing, optimizing, and deploying neural network models directly on mobile and resource-constrained edge devices. The framework distinguishes itself through a robust model optimization toolkit that supports quantization, compression, and structural graph manipulation to minimize memory footprint and maximize execution speed. It features a modular architecture that abstracts hardware-specific backends, allowing models to run efficiently across diverse

Rerun is a multimodal data visualizer and robotics data logger designed for rendering synchronized streams of 3D spatial data, images, and time-series metrics. It functions as a tool for capturing high-frequency sensor data and AI outputs into a queryable columnar format, providing a dedicated interface for viewing MCAP recording files and analyzing physical environments. The project distinguishes itself as a machine learning dataset streamer, capable of feeding logged recordings directly into GPU buffers and PyTorch training pipelines without intermediate exports. It supports a high-performa

InternVL is a vision-language model framework that fuses a visual encoder with a large language model to translate image features into textual tokens for reasoning. It provides a system for multimodal inference and dialogue, enabling the processing of images and text to answer questions or generate descriptions. The project is distinguished by its high-resolution image processing, which uses dynamic tiling to maintain detail for images up to 4K resolution, and its chain-of-thought visual reasoning for solving complex mathematical and spatial problems. It also supports temporal frame sampling

This project is a structured learning curriculum and technical reference for mastering deep learning with TensorFlow. It provides a comprehensive guide for building, training, and deploying neural networks, combining theoretical fundamentals with practical implementation examples. The repository distinguishes itself by covering the end-to-end machine learning workflow, from low-level tensor mathematics and linear algebra to the creation of complex model architectures. It includes specific guidance on developing data pipelines for diverse data types, such as images, text, and time-series seque

DeepLake is AI data infrastructure consisting of a multimodal data lake, a hybrid search engine, and a serverless vector database. It provides a PostgreSQL-based AI data runtime that combines multimodal storage with streaming pipelines to load and shuffle datasets from cloud storage directly into deep learning training pipelines. The system utilizes lazy indexing to store and slice images, audio, and video without loading entire files into memory. It enables retrieval-augmented generation by persisting high-dimensional embeddings in a serverless vector store and implementing hybrid search tha

LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters

BasicSR is a PyTorch-based image restoration toolbox and framework designed for training and deploying deep learning models to upscale, denoise, and deblur images and videos. It serves as a comprehensive system for image super-resolution and video quality restoration, providing the necessary infrastructure to recover fine visual details and increase pixel density. The project distinguishes itself through specialized toolkits for facial image enhancement and high-fidelity face synthesis, as well as a dedicated video quality restoration suite that utilizes deformable convolutions and generative

This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene

mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp

The Book of Shaders ist ein interaktiver Bildungsleitfaden und Lehrplan zum Erlernen der GLSL-Fragment-Shader-Programmierung zur Erstellung prozeduraler Grafiken und visueller Effekte. Er bietet einen strukturierten Lernpfad und ein kategorisiertes Referenzhandbuch für Datentypen, eingebaute Funktionen und mathematische Operationen, die in der Shader-Entwicklung verwendet werden. Das Projekt bietet eine Web-basierte Shader-Sandbox und einen interaktiven Editor, der Echtzeit-Iteration und Visualisierung von GLSL-Code ermöglicht. Benutzer können mit prozeduraler Kunst experimentieren und ihre Ergebnisse über eindeutige URLs teilen. Der Lehrplan deckt ein breites Spektrum an Grafikprogrammierungsfähigkeiten ab, einschließlich Signed Distance Fields, Koordinatentransformationen, Rausch-basierter Synthese und Bildverarbeitungsfiltern. Er umfasst zudem fortgeschrittene Techniken wie Ray Marching für das Rendering dreidimensionaler Szenen und die Simulation dynamischer physikalischer Systeme. Die Bildungsinhalte werden über ein Build-System bereitgestellt, das Markdown-Quelldateien in lokalisierte HTML-Seiten und Multi-Format-Dokumente transformiert, einschließlich PDF, EPUB und LaTeX.

Tensorpack ist ein High-Level-TensorFlow-Framework für neuronale Netze und eine Forschungsbibliothek für den Aufbau und das Training von Deep-Learning-Modellen. Es bietet eine Sammlung reproduzierbarer Architekturen neuronaler Netze für Computer Vision, generative Aufgaben, Reinforcement Learning und Natural Language Processing. Das Projekt zeichnet sich durch eine spezialisierte Deep-Learning-Daten-Pipeline aus, die reines Python für paralleles Datenladen und Streaming verwendet. Es enthält einen Multi-GPU-Trainings-Orchestrator zur Verteilung von Workloads mittels Data-Parallel-Strategien und ein dediziertes Interpretierbarkeits-Toolkit zur Visualisierung von Modell-Saliency- und Aktivierungskarten. Das Framework deckt ein breites Spektrum an Funktionen ab, einschließlich Computer-Vision-Pipelines für Objekterkennung und semantische Segmentierung, Sequenzmodellierung für Sprache und Text sowie die Entwicklung von Reinforcement-Learning-Agenten. Es bietet zudem Modelloptimierungstools für Gewichtsquantisierung und Low-Bitwidth-Training sowie Utilities zur Reproduktion akademischer Forschungsarbeiten und zur Konvertierung von Legacy-Caffe-Modellgewichten.