Awesome GitHub RepositoriesPyTorch Model Components

This is a PyTorch attention mechanism library and a collection of deep learning model components. It provides reference implementations of research-based attention mechanisms and neural network layers used to verify and understand deep learning papers. The project facilitates deep learning research implementation and attention mechanism prototyping to capture global and local dependencies within complex datasets. It includes tools for neural network architecture design, specifically for building custom model components. The library covers the development of multi-layer perceptrons, convoluti

Kornia is a differentiable computer vision library and cross-framework tensor vision toolset. It implements vision operations as differentiable tensors to enable integration into deep learning pipelines and supports the transpilation of operations across PyTorch, TensorFlow, JAX, and NumPy. The project provides specialized toolsets for geometric vision and stereo depth, including algorithms for 3D scene reconstruction, camera calibration, and pose estimation. It further distinguishes itself as a differentiable image augmentation framework, applying random geometric and color transformations w

This project is a Transformer machine translation model and attention-based neural network implemented using the PyTorch deep learning framework. It functions as a text-to-text translation tool designed to convert source sequences into target language text. The implementation focuses on neural machine translation, covering the development of sequence-to-sequence architectures. It includes the full pipeline for translation, from text sequence preprocessing and vocabulary creation to model training and text generation inference. The system incorporates standard transformer components such as a

This project is a pretrained model library for PyTorch, providing a collection of convolutional neural network architectures and weights. It serves as a computer vision model zoo for image classification and feature extraction, offering a framework for transfer learning where pretrained networks are adapted for custom image recognition tasks. The library focuses on transforming images into high-level numerical representations and calculating class probability scores. It includes utilities for downloading and initializing standard architectures such as ResNet, Inception, and Xception. Capabil

This project is a PyTorch vision transformer framework designed for self-supervised learning. It implements a model that trains visual representations using a momentum teacher and self-distillation without the need for labeled data. The library functions as an image feature extractor and visual attention visualizer, allowing for the generation of high-dimensional vectors and the rendering of self-attention maps as heatmaps or videos to analyze model focus. It provides comprehensive tools for downstream vision evaluation, including linear probe classification, k-nearest neighbor categorizatio

SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset for video action recognition, enabling the training and evaluation of models designed to classify complex activities and objects within video sequences. The framework is distinguished by its use of dual-pathway spatiotemporal sampling to capture both slow and fast motions. It supports self-supervised video learning for pre-training models on unlabeled data and employs multigrid spatiotemporal training to optimize learning across multiple spatial and temporal resolutions. The

DUSt3R is a geometric vision transformer model that predicts dense 3D pointmaps directly from one or more uncalibrated images, without requiring prior camera intrinsics, extrinsics, or known camera positions. Its core identity is an end-to-end approach to 3D reconstruction that bypasses traditional depth estimation and camera calibration pipelines, instead outputting metric-scale 3D coordinates from RGB inputs. The model processes image pairs through a shared dual-image encoder architecture, using cross-attention feature fusion in the decoder to merge features from two images into a unified p

Metaseq 是一个 Transformer 序列建模工具包，专为使用开放预训练权重进行序列到序列模型的训练、微调和部署而设计。它为大语言模型训练提供了一个全面的框架，包括用于序列数据集处理的专用工具，以及用于通过 API 请求生成文本的独立推理服务器。 该项目具有用于模型量化的专用实用程序，可将参数精度降低到 8 位，从而降低内存使用量并提高推理速度。它还包括一个检查点转换流水线，将模型权重转换为针对高性能推理引擎优化的结构。 该框架通过使用张量并行和分片数据并行，支持跨 GPU 集群的大规模训练。其他功能涵盖 NLP 数据集准备、用于迁移学习的预训练权重加载，以及用于进度可视化的训练指标跟踪。

The official PyTorch implementation of Google's Gemma models

This project is a deep learning educational resource consisting of PyTorch model implementations and code examples. It provides functional Python scripts and notebooks for building, training, and optimizing neural networks using tensor-based computation. The repository includes implementations for designing custom network layers and loss functions, as well as examples of transfer learning workflows that load pretrained model weights to accelerate development. The codebase covers a broad range of deep learning capabilities, including neural network training, custom model component design, and

mmaction2 是一个 PyTorch 视频理解工具箱，专为训练和评估深度学习模型而设计。它作为一个用于动作识别、时间定位和时空动作检测的框架，为基于像素的视频分析和基于骨架的动作识别提供了专业工具。 该项目以其模块化架构而著称，具有基于注册表的组件发现和分层、配置驱动的模型组装功能。它支持多模态特征融合，集成 RGB 帧、光流和音频，并包括用于文本到视频片段检索和零样本视频预测的功能。 该框架广泛涵盖了视频数据集工程，包括标注标准化和帧采样，以及全面的模型训练和评估。它提供用于分布式训练、知识蒸馏和通过模型重参数化进行推理优化的实用程序。 该代码库支持 ONNX 模型导出和用于跨不同计算节点部署的环境容器化。

这是一个关于使用 PyTorch 构建神经网络的综合教学资源和课程。它涵盖了深度学习的基本构建块，包括张量操作、自动微分以及模块化神经网络组件的构建。 该仓库是多个专业领域的参考指南。它提供了计算机视觉任务（如图像分类、目标检测和语义分割）的实现细节，以及涉及 Transformer、循环网络和生成模型的自然语言处理工作流。此外，它还包括生成式 AI 的参考资料，专门关注通过扩散模型和对抗网络进行图像合成。 材料延伸至模型优化和部署流水线。它涵盖了通过量化和将模型导出为 ONNX 和 TensorRT 等格式来减小模型大小并提高推理速度的技术。其他能力领域包括用于并行加载的数据工程、使用自定义指标的模型评估，以及开源大语言模型的部署。 该项目主要以一系列 Jupyter Notebook 的形式提供。

pytorch-summary 是一个 PyTorch 神经网络工具集合，旨在生成模型摘要、计算内存需求并可视化逐层张量形状。它作为一个报告工具，提供网络层和输出形状的详细分解，以辅助模型调试和检查。 该项目提供专门的功能，用于根据输入维度和参数数量估算前向和后向传递的总内存使用量。它生成模型结构的人类可读可视化，以验证架构设计并识别各层之间的维度不匹配。 该工具通过递归模块遍历、基于钩子的张量跟踪和输入驱动的形状推断来实现结构分析。这些功能允许聚合参数数量并映射连续操作之间的数据流。

This project is a collection of deep learning research implementations and a reproduction kit designed to translate theoretical AI papers into working code. It provides a library of neural network architectures and reference implementations for reproducing seminal research concepts through interactive notebooks. The repository distinguishes itself through the implementation of AI theory and scaling laws, covering complexity dynamics, information theory, and the simulation of universal AI agents. It also includes a benchmarking suite for synthetic reasoning, allowing for the evaluation of mode

Graph Nets is a graph neural network library and educational toolkit implemented in PyTorch, providing implementations of popular graph representation learning algorithms and research papers. The project covers core graph machine learning tasks including semi-supervised node classification, inductive and unsupervised node embedding generation, and neighborhood feature aggregation. The library supports diverse algorithmic approaches for processing network structures, ranging from shared-parameter graph convolutions and attention-weighted neighborhood aggregation to spectral Chebyshev filtering