Open-source alternatives to MiDaS

This project is an RGB-D image inpainting tool and framework for 3D photo reconstruction. It transforms single 2D images into 3D content by estimating monocular depth and synthesizing missing color and depth data to fill occluded regions. The system uses a layered depth image representation to manage scene boundaries and pixel connectivity. This allows for novel view synthesis, enabling the generation of videos that simulate motion parallax effects from different camera perspectives. The project covers a range of spatial modeling capabilities, including depth map estimation, disparity-based

The Intel RealSense SDK is a software development kit providing drivers and libraries for interfacing with depth cameras to capture color, depth, and infrared data streams. It includes a depth camera driver for device discovery and sensor configuration, a stereo vision library for computing depth maps and aligning frames, and a 3D point cloud generator to transform depth and infrared frames into spatial representations. The SDK distinguishes itself through on-chip depth calculation and stereo calibration, using internal vision processors to reduce host CPU load. It supports hardware-level str

This project is a computer vision system for monocular depth estimation and 3D point cloud generation. It provides a supervised depth learning framework and a depth predictor capable of estimating spatial distance and disparity from single 2D images using pretrained neural networks. The system includes tools to transform 2D depth images into 3D point clouds via pixel coordinate backprojection and converts 3D point cloud data into 2D depth maps. It utilizes a training pipeline that supports model fine-tuning and hyperparameter optimization. The library covers broader capabilities in spatial a

jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti

MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable framework for building, training, evaluating, and deploying segmentation models. At its core, it offers a config-driven pipeline that assembles training, evaluation, and inference workflows by parsing hierarchical configuration files, with a modular component registry that enables plug-and-play composition of neural network modules, optimizers, datasets, and metrics. The framework supports the full model lifecycle through a unified runner interface that controls training, testi

This project is a comprehensive instructional resource and course for building neural networks using PyTorch. It covers the fundamental building blocks of deep learning, including tensor manipulation, automatic differentiation, and the construction of modular neural network components. The repository serves as a technical guide for several specialized domains. It provides implementation details for computer vision tasks such as image classification, object detection, and semantic segmentation, as well as natural language processing workflows involving transformers, recurrent networks, and gen

This project is a comprehensive computer vision library for the PyTorch ecosystem, providing a standardized collection of neural network architectures, datasets, and high-performance transformation utilities. It serves as a foundational framework for building, training, and deploying deep learning models, offering a centralized model registry that allows developers to instantiate architectures with pre-trained weights for tasks such as image classification, object detection, and semantic segmentation. The library distinguishes itself through its modular approach to data and compute management

This is a PyTorch deep learning implementation for training transformer-based language models. It functions as a distributed GPU trainer and framework designed to optimize text prediction models for increased speed and sample efficiency. The project is distinguished by its use of the Newton-Schulz weight optimizer. This method applies an iterative process to maintain semi-orthogonal parameter updates and weight matrices, which improves sample efficiency and reduces memory overhead during the training process. The framework covers broad capabilities in distributed GPU computing, including dat

This project is a monocular depth estimation model and computer vision framework designed to calculate absolute distance and scale from single images. It functions as a metric depth estimator that generates high-resolution depth maps without requiring camera-specific focal length metadata. The system utilizes a vision transformer architecture for feature extraction and zero-shot inference to produce metric-scale depth predictions. It includes specialized components for sharp-boundary depth refinement to maintain high-frequency edge details and prevent blurriness at object boundaries. The rep

DAIN is a video frame synthesis engine and AI video upsampling tool designed to increase video playback smoothness. It functions as a computer vision model that synthesizes intermediate frames between existing images to transform low frame rate video into high frame rate content. The system utilizes depth-aware video frame interpolation to predict the motion of pixels between consecutive images. By analyzing spatial depth via depth maps, the tool generates new frames that account for occlusions and overlapping objects to create slow motion effects. The framework incorporates optical flow int

ComfyUI-3D-Pack is a suite of custom nodes for ComfyUI that enables 3D asset generation and rendering within a node-based workflow. It provides a set of tools for reconstructing textured three-dimensional meshes and volumetric scenes from single images, multi-view images, or text prompts. The system includes a Gaussian splatting generator for creating high-fidelity volumetric 3D scene representations and a multi-view image generator to produce consistent image sets for reconstruction. It also features a single image 3D mesh tool to build geometry from a single 2D source. The toolset covers 3

This project is a PyTorch-based computer vision library and deep learning image processing framework. It provides a collection of neural network architectures designed for visual analysis tasks, specifically focusing on image classification, object detection, and semantic segmentation. The toolset implements diverse methodologies for visual recognition, including anchor-free object detection, regional proposal networks, and heatmap-based keypoint estimation. It utilizes both convolutional neural networks for spatial feature extraction and transformer-based self-attention mechanisms to compute

Sapiens is a high-resolution human vision model designed for high-precision, human-centric computer vision tasks. It functions as a suite of tools for estimating human pose, depth, and surface geometry. The project utilizes a vision transformer backbone to perform multiple tasks through a shared encoder. This architecture enables the simultaneous prediction of skeletal structures, joint locations, and the distance between a camera and a human subject. The model's capabilities cover human body part segmentation to isolate anatomical regions from backgrounds and surface normal prediction to re

VGGT is a computer vision framework designed for neural scene reconstruction and 3D environmental modeling. It utilizes a feed-forward neural architecture to process input images, simultaneously inferring camera parameters, depth maps, and point trajectories to generate dense 3D point clouds. The system distinguishes itself by integrating multi-view geometry with temporal tracking, allowing it to maintain spatial consistency across sequential frames. By leveraging pretrained neural backbones, the framework extracts robust visual features that support complex geometric tasks, including the ana

This project is a PyTorch library for building and training Kolmogorov-Arnold Networks. It implements a neural network architecture that replaces fixed activation functions with learnable spline-based functions on edges, serving as a tool for interpretable machine learning. The implementation utilizes reformulated matrix operations to reduce memory overhead and increase computation speed. It employs L1 regularization to sparsify network weights, which improves the transparency of the model's internal logic and decisions. The framework covers a range of capabilities including grid-based funct

This project is a PyTorch implementation of a text-to-image transformer. It is a generative AI model designed to map discrete text tokens to image pixels using a transformer network to create visual content from textual descriptions. The system utilizes a discrete VAE image encoder to compress visual data into tokens for transformer processing. It supports classifier-free guidance to adjust the influence of text prompts during inference and includes capabilities for ranking generated images based on their similarity to text prompts. The architecture incorporates sparse attention mechanisms a

This project is a PyTorch implementation of StyleGAN2, providing a library and research framework for training style-based generative adversarial networks. It serves as a toolkit for high-resolution image synthesis, utilizing competitive minimax optimization to create realistic synthetic visual content. The framework incorporates specialized architectural components such as style-based latent mapping, multi-scale feature modulation, and self-attention layers to improve structural coherence. It distinguishes itself with advanced training stability techniques, including exponential moving avera

The official PyTorch implementation of Google's Gemma models

Code release for ConvNeXt model

This project is a PyTorch implementation of the YOLOv3 object detection architecture. It functions as a real-time object detector and computer vision framework designed to identify and locate multiple objects within images using bounding boxes and class labels. The system allows for both the use of pretrained weights for immediate image analysis and the training of custom models using datasets with bounding box annotations. It provides a programmatic interface to integrate detection capabilities directly into other software applications. The framework includes tools for model evaluation to m

This project is a PyTorch implementation of an attention-based neural network designed for sequence-to-sequence deep learning tasks. It serves as a library for constructing deep learning sequence models that utilize encoder and decoder structures to process natural language and sequential data. The implementation centers on a multi-head attention mechanism to capture diverse relationships between tokens without using recurrence. It includes sinusoidal positional encoding to maintain sequence order and point-wise feed-forward networks to transform token positions independently. The architectu

This project is a deep learning educational resource consisting of PyTorch model implementations and code examples. It provides functional Python scripts and notebooks for building, training, and optimizing neural networks using tensor-based computation. The repository includes implementations for designing custom network layers and loss functions, as well as examples of transfer learning workflows that load pretrained model weights to accelerate development. The codebase covers a broad range of deep learning capabilities, including neural network training, custom model component design, and

This project is a deep learning research toolkit and generative model library providing implementations of Variational Autoencoders using the PyTorch framework. It serves as a framework for training and evaluating autoencoder architectures to learn latent representations for data reconstruction and the generation of synthetic data samples. The toolkit focuses on unsupervised feature learning and generative model training, featuring a system for mapping external configuration files to model hyperparameters to ensure reproducible experimental runs. It includes mechanisms for tracking training p

This project is an educational resource and comprehensive guide for implementing and deploying deep learning models using the PyTorch framework. It provides a structured learning curriculum consisting of tutorials and notebooks that cover neural network architectures, data pipelines, and model optimization across multiple AI domains. The curriculum includes practical implementation guides for building convolutional networks, transformers, and recurrent models. It specifically focuses on workflows for computer vision, including image classification, object detection, and segmentation, as well

Avatarify-python is a real-time face animation tool that uses a PyTorch-based neural network to map facial movements from a live camera feed onto a static image. It creates photorealistic animated avatars that mimic a user's movements for use in video software. The project includes a remote GPU inference client that offloads heavy computational workloads to a remote server, allowing high-performance animations to run on low-spec hardware. It also features a virtual webcam driver to route synthetic video streams into video conferencing applications as a standard camera device. The system prov

This project provides a clean implementation of the latent diffusion model architecture using the PyTorch framework. It functions as a generative machine learning pipeline designed to synthesize images from text prompts by loading pre-trained model weights into a modular neural network structure. The implementation focuses on the mechanics of image generation, utilizing a tensor-based computational graph to execute the complex linear algebra required for inference. It incorporates transformer-based text encoding to map natural language into vector embeddings, which are then integrated into th

This project is an educational course and collection of training materials focused on generative diffusion models. It provides a curriculum and practical guides for training, fine-tuning, and deploying models capable of synthesizing images, audio, and video. The material covers specific implementation strategies including noise-based synthesis, iterative refinement, and latent space compression. It provides instruction on guiding generative outputs through conditional synthesis and prompt adherence optimization, as well as techniques for image inpainting and text-based editing. The project i