Awesome GitHub RepositoriesTraining Dataset Processing

This repository is a collection of Jupyter notebooks providing reference implementations and templates for building, training, and deploying machine learning models using Amazon SageMaker. It serves as an example library for implementing model architectures and automating the machine learning lifecycle. The library provides practical patterns for machine learning training, data engineering, and model deployment. It includes implementation guides for MLOps, including workflows for model monitoring, lineage tracking, and hyperparameter tuning. The examples cover a broad range of capabilities i

This project is a structured learning curriculum and technical reference for mastering deep learning with TensorFlow. It provides a comprehensive guide for building, training, and deploying neural networks, combining theoretical fundamentals with practical implementation examples. The repository distinguishes itself by covering the end-to-end machine learning workflow, from low-level tensor mathematics and linear algebra to the creation of complex model architectures. It includes specific guidance on developing data pipelines for diverse data types, such as images, text, and time-series seque

ART is a platform for agentic training, providing a reinforcement learning framework, training environment, and compute orchestrator. It enables the improvement of multi-step agent reasoning and tool usage through group relative policy optimization and a judge-based reward modeling system. The project features tools for model distillation to transfer capabilities from large teacher models to smaller architectures, as well as a system for capturing execution trajectories to generate synthetic training data. It supports specialized training workflows including supervised fine-tuning for baselin

This repository contains programming assignments and lecture notes from Andrew Ng's foundational deep learning course specialization on Coursera. The materials cover core neural network training techniques including optimization algorithms, normalization methods, regularization approaches, parameter initialization strategies, and learning rate scheduling to improve model convergence and generalization. The coursework explores design principles where successive neural network layers learn progressively more abstract feature representations from input data. It provides guidance on selecting ope

gpt-neox is a distributed training system and framework for building large-scale autoregressive language models. It implements the transformer architecture and provides a toolkit for training models with billions of parameters by distributing weights across compute clusters. The framework distinguishes itself through extensive support for distributed model parallelism, including pipeline and sequence parallelism, to overcome single-device memory limits. It further supports sparse model architectures using a mixture of experts system with Sinkhorn-based routing. The project covers a broad ran

This project is a machine learning educational resource and implementation guide for Python. It provides a collection of executable code and notebooks that demonstrate predictive modeling, data analysis workflows, and the implementation of various machine learning algorithms. The repository features practical examples of classification, regression, and clustering tasks using Scikit-Learn, alongside tutorials for building and training deep learning architectures with TensorFlow. These include implementations of convolutional and recurrent networks. The content covers a broad range of capabili

Feast is a machine learning feature store and MLOps data infrastructure layer. It provides a centralized system for managing and serving features across offline training and online production environments, utilizing an online feature serving layer for low-latency retrieval. The project centers on a feature registry that acts as a central catalog for defining, governing, and discovering feature services. It employs a unified data access layer to decouple feature retrieval from physical storage and includes a point-in-time data generator to create historically accurate training datasets that pr

MMDetection3D is an open-source toolbox for 3D perception, providing a unified framework for detecting and segmenting objects in three-dimensional environments. It supports a range of core tasks including monocular 3D object detection from single camera images, LiDAR-based 3D object detection from raw point clouds, and multi-modal fusion that combines camera images with LiDAR data. The toolbox also covers point cloud semantic segmentation, assigning class labels to every point in a scan for scene understanding. The project distinguishes itself through a config-driven pipeline that orchestrate

该项目是一个深度学习系列教程和教育课程，旨在教授 PyTorch 基础知识。它作为掌握神经网络架构、自动微分以及张量和动态计算图使用的结构化训练指南。 该课程侧重于实际实现，专门指导推荐系统、广告模型和兴趣网络的发展，以预测用户偏好。它还提供用于时间序列预测和处理序列数据的教学内容。 该材料涵盖了广泛的深度学习能力，包括构建用于图像和文本分类以及结构化数据的模型。它结合了用于 GPU 加速、训练指标可视化以及创建用于测试模型预测的 Web 界面工作流。 该项目以 Jupyter Notebooks 合集的形式提供。

River 是一个用于在线机器学习的 Python 框架，旨在对流式数据进行模型训练和评估。它通过一次处理一个观测值来更新模型参数，从而实现增量学习，无需在内存中存储完整的训练数据集。 该库通过专门的概念漂移（Concept Drift）检测系统脱颖而出，该系统监控数据分布的变化以触发模型自适应。它还提供了一个渐进式验证框架，通过在训练前对样本进行测试来模拟实时部署。 该系统涵盖了广泛的流式处理功能，包括实时特征工程、时间序列预测和在线异常检测。它支持通过增量聚类和决策树进行无监督学习，以及用于模型选择的集成聚合和 Bandit 策略。 该项目包括从 CSV 文件和 API 等来源进行流式数据摄取的实用程序，以及用于计算运行统计信息和内存高效数据草图（Data Sketches）的工具。

Torchtune is a PyTorch-native library for fine-tuning, aligning, and quantizing large language models. It provides a config-driven system for instantiating components, orchestrating distributed training, and managing parameter-efficient fine-tuning with quantization support, all through YAML-based configurations and command-line overrides. The library distinguishes itself through its comprehensive post-training workflow orchestration, combining supervised fine-tuning, preference optimization (DPO, PPO, GRPO), knowledge distillation, and quantization-aware training in a single configurable pip

This project is an alignment framework and suite of pipelines for training language models using supervised fine-tuning and preference optimization. It provides tools for executing large-scale distributed training across multiple GPUs and compute nodes, alongside a system for measuring model helpfulness and dialogue quality through single-turn and multi-turn benchmarks. The framework includes specialized tools for direct preference optimization to refine model behavior using paired data without a separate reward model. It also supports constitutional AI alignment and the training of reward mo

PCDet is a LiDAR 3D object detection toolbox and point cloud processing library built on the PyTorch deep learning framework. It provides a system for identifying and locating three-dimensional objects within point cloud data. The project utilizes a data-model separation pattern to decouple dataset loading logic from the core detection pipeline. It features a multi-sensor fusion pipeline that combines data from multiple sensors into a shared spatial view and a distributed GPU training system to scale workloads across multiple graphics processors. The toolkit covers several capability areas,

MuseTalk is a deep learning lip synchronization system designed to align video facial movements with audio tracks for high-fidelity video dubbing. It functions as an engine that matches facial expressions to audio input in real-time, enabling the modification of a speaker's lip movements to match new audio sources across different languages. The project features a distributed GPU training pipeline and a multi-stage processing workflow for refining the visual accuracy of synthetic speech. It distinguishes itself through the use of region-specific face masking and mouth openness control, which

OpenVLA is a vision-language-action model and framework designed for general-purpose robotic manipulation. It provides a robotic policy training framework and a control inference engine that map visual and textual inputs to robotic control actions, enabling zero-shot instruction following on hardware. The project includes a robotics dataset pipeline for standardizing diverse trajectory data and managing dataset mixtures. It supports large-scale model training through distributed GPU compute and sharded data parallelism, alongside parameter-efficient adaptation for fine-tuning models to new ta

xtuner 是一个用于大语言模型的综合训练引擎，提供用于预训练、监督微调以及视觉-语言多模态模型优化的工具包。它作为一个分布式训练加速器和专门的框架，用于扩展专家混合（MoE）模型，并通过人类反馈强化学习（RLHF）来对齐模型行为。 该项目的特色在于先进的内存和计算优化，例如用于超长上下文窗口的序列并行，以及用于减少 GPU 空闲时间的交错流水线并行。它提供了一套专门的偏好优化套件，实现了如组相对策略优化（GRPO）和直接偏好优化（DPO）等技术，以优化模型策略和奖励系统。 广泛的功能领域涵盖跨多节点的分布式模型训练、多模态数据集准备以及基于适配器（Adapter）的微调管理。该引擎还包括用于模型评估、权重合并以及将训练参数导出到推理引擎的工具。 训练通过标准化的配置文件和分布式启动器进行管理，以确保跨计算集群的一致结果。

这是一个神经风格迁移框架，提供了一套用于将艺术风格应用于图像和视频的计算机视觉工具。它充当用于训练前馈神经网络、迭代风格优化器和实时视频风格化器的系统。 该框架支持两种主要的风格化方法：一种是一次性应用风格的前馈模型，另一种是无需预训练模型通过最小化内容和风格损失来生成风格化图像的迭代优化方法。它还支持使用训练好的模型对实时摄像头画面进行实时处理。 该项目涵盖了多个功能领域，包括艺术图像处理、通过感知损失最小化进行的风格迁移模型训练，以及将图像文件夹格式化为兼容训练集的数据集准备工具。

本项目是一个 PyTorch 深度学习教程和教育资源。它提供了一个结构化的课程和分步指南，用于从零开始设计、训练和验证神经网络。 该资源包含关于计算机视觉实现的具体指南，重点介绍使用卷积神经网络进行目标检测和图像分类。它还提供了通过硬件加速优化模型性能以缩短训练时间的说明。 这些材料涵盖了完整的模型开发生命周期，包括张量运算、图像数据集准备，以及损失函数和优化器的使用。它还通过保存和重新加载训练好的权重来解决模型生命周期管理问题。

本项目提供了一系列经过处理的中文对话数据集和预处理工作流，旨在用于大语言模型的训练和指令微调。它作为一个由清洗、标准化的中文文本组成的训练语料库，格式为查询-回答对。 该仓库包含一个预处理流水线和数据集聚合器，将多个公共聊天来源合并为统一文件。这些工具通过将繁体中文字符转换为简体字符，并将复杂的对话线程转换为标准化的单轮序列来规范化文本。 生成的数据导出为独立的制表符分隔值文件，确保了不同来源之间的一致模式。该工程工作流专注于消除格式不一致，为机器学习任务准备原始对话数据。

该项目是一个深度学习教育课程和实现指南，专为构建和训练神经网络而设计。它提供了一个开发模型以解决模式识别和生成任务的课程。 该材料包括用于计算机视觉训练、自然语言处理和生成式 AI 的专门模块。它涵盖了迁移学习在分类新数据中的实际应用以及合成媒体的创建。 该项目包含网络架构设计、机器学习数据流水线的构建，以及使用模型性能诊断来识别欠拟合或过拟合。 内容通过 Jupyter Notebook 交付。