Open-source alternatives to Pix2pixHD

pix2pix is a framework for image-to-image translation using conditional generative adversarial networks. It functions as a supervised trainer and visual domain mapper designed to learn a mapping between input and output images for style and domain transfer. The system utilizes a U-Net encoder-decoder architecture combined with a PatchGAN local discriminator to enforce high-frequency local consistency. It employs L1 loss regularization to ensure generated outputs remain structurally close to the ground truth. The project covers a broad range of computer vision capabilities, including semantic

mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp

This project is a PyTorch object detection framework that implements the Faster R-CNN architecture. It serves as a vision model for predicting precise bounding boxes around multiple objects within images and live video feeds. The system is optimized for multi-GPU training to reduce the time required for model convergence. It utilizes a GPU-accelerated design to handle the training and inference of complex detection networks. The framework covers the full object detection lifecycle, including custom network training and inference for static images and real-time video streams. It includes capa

A pytorch implementation of Paper "Improved Training of Wasserstein GANs"

Image Deblurring using Generative Adversarial Networks

CycleGAN is a generative adversarial network framework designed for unpaired image-to-image translation. It enables the conversion of images between two distinct visual domains using datasets that do not require direct one-to-one matching examples. The project implements a deep learning style transfer tool capable of artistic style transfer, object transfiguration, and domain-to-domain conversion. It uses a dual-generator architecture and cycle-consistency loss to ensure that images translated to a target domain and back recover their original state. The framework covers core machine learnin

We have a reimplementation of the UNIT method that is more performant. It is avaiable at Imaginaire

This project is a TensorFlow implementation of an image-to-image translation framework based on conditional generative adversarial networks. It provides the tools to train models that map input images to output images based on learned visual patterns, as well as a server for processing image translation requests and serving trained model checkpoints to web clients. The framework includes a system for converting trained model weights into a portable format for browser-based inference. It also features a validation process that generates comparative reports by analyzing input, output, and targe

PyTorch-GAN is a research-oriented framework providing a collection of modular implementations for generative adversarial network architectures. It serves as a toolkit for training and evaluating models that utilize adversarial minimax optimization to produce synthetic data, offering a structured environment for exploring complex generative tasks within the PyTorch ecosystem. The library distinguishes itself through a comprehensive suite of image synthesis and manipulation capabilities, including super-resolution, inpainting, and cross-domain style translation. It supports advanced training m

Fairseq is a PyTorch toolkit for sequence-to-sequence modeling, specializing in neural machine translation, automatic speech recognition, and large-scale language model training. It provides a framework for processing and aligning diverse data sources, including text, audio, and video, to support tasks such as speech-to-text conversion and multimodal sequence learning. The project is distinguished by its distributed training capabilities, which utilize parameter sharding, mixed-precision training, and CPU offloading to handle models that exceed single-device memory. It also includes specializ

Keras-GAN is a collection of generative adversarial network implementations built with Keras for synthetic data generation and image manipulation. It provides frameworks for image-to-image translation, image inpainting, and neural image super-resolution. The library includes tools for learning disentangled latent space representations to control specific attributes of synthetic outputs. It also features capabilities for image domain translation using paired or unpaired data and the ability to fill corrupted or missing image parts by analyzing surrounding visual context. The project covers ge

This is a PyTorch implementation of a text-to-image model designed for synthesizing high-fidelity images from natural language descriptions. It utilizes a diffusion image generator to transform latent embeddings into visual data through an iterative denoising process. The system employs a two-stage latent mapping process, using a CLIP-based latent prior to map text embeddings to image embeddings before decoding them into pixels. It features a cascading diffusion decoder that produces high-resolution imagery by passing low-resolution outputs through a sequence of models at increasing scales.

This project is a modular PyTorch framework for training and evaluating object detection and instance segmentation models. It serves as a computer vision research tool and a deep learning inference engine designed to identify object locations, classes, and pixel-level masks within images. The framework implements a two-stage inference pipeline that utilizes region proposal networks and a symmetric mask-head architecture. It provides specialized capabilities for instance segmentation, object bounding box detection, and human pose estimation via anatomical keypoint detection. The system includ

YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef

PyTorch implementation of Image-to-Image Translation Using Conditional Adversarial Networks.

Pytorch implementation for high-resolution (e.g., 2048x1024) photorealistic video-to-video translation. It can be used for turning semantic label maps into photo-realistic videos, synthesizing people talking from edge maps, or generating human motions from poses. The core of video-to-video…

Wasserstein GAN

A simple PyTorch Implementation of Generative Adversarial Networks, focusing on anime face drawing.

PyTorch implementation of "Learning to Discover Cross-Domain Relations with Generative Adversarial Networks"

This is a PyTorch implementation of the paper NIMA: Neural IMage Assessment (accepted at IEEE Transactions on Image Processing) by Hossein Talebi and Peyman Milanfar. You can learn more from this post at Google Research Blog.

The author's officially unofficial PyTorch BigGAN implementation.

simple generative adversarial network (GAN) using PyTorch

This project is an unsupervised image restoration tool that uses a convolutional neural network as a structural prior to reconstruct images from noisy or incomplete data. It functions as a neural network image prior, utilizing the inherent biases of the network architecture to restore pixels without the need for a pre-trained dataset or external learning. The system performs zero-shot image restoration by treating the network architecture itself as a regularization term. It uses a randomly initialized encoder-decoder structure and iterative gradient descent to minimize pixel-wise loss, recove

Code for the paper "Adversarial Generator-Encoder Networks"

pytorch implementation of fast-neural-style

StyleGAN is a TensorFlow-based generative adversarial network framework designed for the synthesis of high-resolution synthetic imagery. It utilizes a style-based generator architecture to create realistic visual assets from latent vectors, focusing on the production of high-fidelity images. The system incorporates style mixing and stochastic noise injection to control visual attributes and fine-grained details. It uses adaptive instance normalization and progressive resolution upsampling to manage image quality and variety across different resolutions. The framework covers the full lifecycl