Awesome GitHub RepositoriesBatch Normalization

This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i

This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

Fastai is a high-level deep learning library built on PyTorch that provides a unified interface for managing the entire machine learning lifecycle. It functions as a comprehensive training toolkit, abstracting hardware management and automating complex training loops to simplify the construction and execution of neural network models. The framework is distinguished by its notebook-centric development environment and a type-dispatching data pipeline that automatically applies transformations based on input data formats. It emphasizes transfer learning through discriminative layer-wise optimiza

Tinyrenderer is a C++ library designed as an educational tool for building a 3D graphics pipeline from scratch. It provides a software-defined rendering environment that executes all geometric transformations and rasterization tasks on the central processor, intentionally avoiding reliance on external hardware acceleration or graphics libraries. The project serves as a pedagogical resource for understanding the fundamental mathematical principles of computer graphics. It enables users to implement custom shader pipelines and core rendering techniques, such as barycentric coordinate calculatio

This project is a PyTorch-based generative framework and implementation template for building Generative Adversarial Networks. It provides a collection of foundational toolkits and architectural patterns designed to synthesize high-quality artificial data while focusing on the stability of adversarial neural networks. The framework distinguishes itself through a specialized toolkit for conditional image generation, which integrates discrete labels and auxiliary classification into the training process. It utilizes specific mechanisms to guide the generative process toward target classes by co

StyleGAN2 is a TensorFlow generative adversarial network and image synthesis model designed to produce high-resolution synthetic visual content. It functions as a deep learning architecture that learns patterns from image datasets to synthesize new images. The project includes a latent space projection tool for mapping existing images to latent vectors to analyze their representation within a generative model. It also provides an image quality evaluation framework to measure the visual fidelity and diversity of synthetic outputs. The system covers the full generative pipeline, including imag

Vowpal Wabbit is an open-source machine learning system designed for online learning, where models update incrementally from streaming data without requiring full retraining. It provides a reduction-based learning framework that composes complex tasks from simpler algorithms, and includes a feature hashing trick that maps unbounded feature names into a fixed-size vector space to keep memory usage constant regardless of dataset size. The system supports distributed training across a cluster using an allreduce protocol for synchronized updates, and offers an active learning query strategy that s

This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene

This repository contains programming assignments and lecture notes from Andrew Ng's foundational deep learning course specialization on Coursera. The materials cover core neural network training techniques including optimization algorithms, normalization methods, regularization approaches, parameter initialization strategies, and learning rate scheduling to improve model convergence and generalization. The coursework explores design principles where successive neural network layers learn progressively more abstract feature representations from input data. It provides guidance on selecting ope

This is a TensorFlow implementation of the Deep Convolutional Generative Adversarial Network (DCGAN) architecture, providing a framework for training generative models that produce synthetic images from random noise vectors. The project implements the core DCGAN design, using transposed convolutions for upsampling, batch normalization for training stability, and leaky ReLU activations in the discriminator, all executed as static TensorFlow computation graphs. The implementation supports training on custom image datasets by accepting user-supplied image folders without requiring a predefined f

本项目提供了一个深度残差网络框架和预训练的 PyTorch 模型，专为高精度图像识别而设计。它实现了一种利用跳跃连接（skip connections）的神经网络架构，能够在不发生梯度退化的情况下训练非常深的模型。 该系统专为计算机视觉任务而设计，包括图像分类、目标检测和视觉数据分割。它包含在 ImageNet 上训练的权重，以支持迁移学习和在自定义图像数据集上进行微调。 架构设计侧重于残差学习块、瓶颈层配置和批归一化，以在训练期间保持稳定性。该框架还采用全局平均池化来减少参数并防止过拟合。

这是一个教育性 Jupyter Notebook 合集，提供了使用 TensorFlow 框架构建神经网络和进行张量运算的教程。它作为机器学习教育仓库和深度学习学生的实现指南。 该套件专注于特定的高级架构，包括用于图像分类的卷积神经网络、用于训练稳定性的残差网络（带跳跃连接），以及用于生成建模和数据合成的变分自编码器。它还包含构建去噪和深度自编码器以进行特征提取和降维的指南。 该仓库涵盖了更广泛的预测建模领域，实现了用于预测连续值和二元结果的线性、多项式和逻辑回归。 内容组织为交互式 Notebook，允许用户执行数学运算并修改机器学习实验。

Composer 是一个 PyTorch 分布式训练框架，旨在实现大规模模型在多节点 GPU 集群上的扩展。它兼具大语言模型训练器、分布式模型优化器和训练生命周期管理器的功能。 该项目作为深度学习正则化库脱颖而出，提供诸如 Sharpness Aware Minimization、MixUp 和 CutMix 等专业优化技术，以提升模型的泛化能力。它还通过序列长度预热、渐进式层冻结以及用于大规模模型恢复的分片状态检查点技术，优化了训练流程。 该框架涵盖了广泛的功能领域，包括分布式训练编排、混合精度硬件管理和云原生数据流。它还为 GPU 内存诊断、训练发散检测和吞吐量跟踪提供了丰富的监控与可观测性工具。 该项目包含一个命令行启动器，可自动执行跨节点的分布式多 GPU 训练任务。

Flashlight is a standalone C++ machine learning library and tensor library used for building and training neural networks. It functions as a comprehensive neural network framework and automatic differentiation engine, providing the tools to construct computation graphs and calculate gradients via backpropagation. The project serves as a distributed training framework, utilizing all-reduce operations to synchronize gradients and parameters across multiple compute nodes and devices. It distinguishes itself through deep integration of high-performance tensor manipulation, native device memory in

This project provides a comprehensive technical guide and framework for engineering large-scale machine learning systems. It covers the full lifecycle of model development, focusing on the infrastructure and computational principles required to build, train, and serve generative AI models across distributed GPU clusters. The repository distinguishes itself by offering deep-dive tutorials and implementation strategies for complex system challenges. It emphasizes high-performance architectural primitives, such as collective communication orchestration, distributed tensor sharding, and static gr

webgl-fundamentals 是一个全面的教育资源和图形教程，用于学习使用 WebGL API 进行硬件加速的 2D 和 3D 渲染。它作为一个结构化的 3D 图形课程和 GPU 编程参考，引导用户从基础几何体到高级渲染技术，完整了解图形流水线。 该项目提供了关于 GLSL 着色器开发的详细指南，包括顶点着色器和片段着色器的创建。它特别专注于实时光照模型的实现（如方向光、点光源和聚光灯），以及阴影映射和纹理映射工作流的应用。 该资源涵盖了广泛的计算机图形能力，包括 3D 空间数学、用于透视和正交视图的相机系统实现，以及矩阵变换的使用。它还包括执行通用 GPU 计算（GPGPU）以及通过索引顶点优化渲染性能的说明。

该项目是一个综合性教育计划和深度学习框架，旨在通过 Notebook 和代码示例教授 PyTorch 深度学习实践。它作为一个用于构建、训练和部署神经网络的高级库，充当模型训练编排器，协调 PyTorch 模型、优化器和损失函数。 该项目为计算机视觉、自然语言处理和表格数据预处理提供了专门的工具包。它通过高级训练控制脱颖而出，例如判别式学习率、用于自定义训练逻辑的双向回调系统，以及自动化设备放置和训练循环的高级学习器抽象。 该框架涵盖了广泛的能力面，包括自动化数据流水线构建、模型架构分析以及跨分类、回归和分割任务的性能评估。它还包括用于跨多个 GPU 进行分布式训练的工具、用于内存优化的混合精度训练，以及对医学影像数据的专门支持。 该项目以一系列 Jupyter Notebook 的形式交付。

PlugNPlay-Modules is a collection of reusable PyTorch computer vision modules and deep learning architectural components. It provides a library of standardized building blocks for constructing neural networks, focusing on attention mechanisms, signal processing layers, and feature fusion modules. The project is distinguished by its extensive variety of attention primitives, covering spatial, channel, and temporal weighting, as well as specialized variants like deformable, frequency-enhanced, and linear-complexity attention. It also implements advanced signal processing tools within the neural

此项目是一个自监督对比学习框架，旨在训练深度学习模型从图像中学习视觉表示，而无需使用人类提供的标签。它提供了一个系统，用于开发可适应下游计算机视觉任务的预训练视觉表示模型。 该框架包括用于半监督图像分类的工具，它结合了大型未标记数据集和小型标记集以提高准确性。它还具有线性探测评估工具，通过在冻结的表示之上训练简单的线性分类器来评估学习到的图像特征的质量。 代码库涵盖了分布式深度学习训练和硬件加速以处理大批量数据，以及优化原语，如余弦衰减学习率调度和权重衰减正则化。它还提供了模型管理实用程序，包括在不同深度学习框架格式之间转换预训练检查点，以及用于模型部署的工具。 该实现以 Jupyter Notebooks 集合的形式提供。

DeepLearningZeroToAll 是一个专注于深度学习和机器学习的综合教育资源和实现集合。它提供了一条使用 TensorFlow 的结构化学习路径，从基础线性模型过渡到复杂的神经网络架构。 该项目以其各种网络类型的实际实现而著称，包括用于逻辑问题的多层感知器、用于空间数据和图像识别的卷积神经网络，以及使用 LSTM 单元进行时间序列预测和字符序列预测的循环神经网络。它还包括通过批量归一化和 Dropout 技术进行模型正则化的详细演示。 该存储库涵盖了广泛的功能，包括线性回归和逻辑回归的监督机器学习、用于张量操作和缩放的数据工程，以及通过梯度下降和手动反向传播计算进行模型优化。它还包括用于模型评估、权重持久化以及通过代价函数可视化和指标记录进行训练可观测性的工具。 内容通过一系列 Jupyter Notebooks 提供。