Image restoration AI

GFPGAN is a generative face restoration model and Python-based image processing tool designed to restore low-resolution facial images. It utilizes generative adversarial networks to recover fine details and increase the clarity of degraded portraits. The system employs a generative facial prior to map degraded images to a high-quality manifold, enabling blind-face restoration without requiring knowledge of the specific degradation process. It utilizes a multi-stage workflow that includes face detection, alignment, and region-specific masking to separate facial areas from the background. Beyo

CodeFormer is a deep learning framework designed for the restoration and enhancement of facial images and video sequences. It functions as a comprehensive processing engine capable of reconstructing high-quality facial features from degraded, blurry, or damaged inputs, while also providing tools for image upscaling and generative inpainting to fill missing or corrupted regions. The system distinguishes itself by utilizing a codebook-based quantization approach that maps input patches to high-quality facial representations, supported by transformer-based global modeling to ensure structural co

DiffBIR is a diffusion-based image restoration framework designed for blind image reconstruction. It utilizes generative diffusion priors to recover high-quality images from sources with unknown or complex degradations without requiring explicit degradation models. The system includes specialized models for face restoration, enabling the recovery of facial landmarks, textures, and backgrounds in degraded portraits. To support high-resolution outputs on hardware with limited memory, it employs a tiled image upscaler that divides images into smaller patches during sampling. The framework cover

SUPIR is an AI image upscaler and restoration system designed to remove artifacts and restore quality to real-world photographs. It functions as a diffusion-based image enhancer and restoration tool that uses large-scale model scaling to produce high-resolution results with photorealistic details. The system balances visual aesthetics with input fidelity, allowing for a trade-off between strict adherence to the original image and the overall visual appeal of the output. It leverages large-scale model inference to improve image clarity and maintain realistic details during the upscaling proces

This project is a deep learning image restoration tool designed to remove scratches, fading, and noise from aged photographs and film. It utilizes generative adversarial networks for image translation, alongside specialized networks for face enhancement and video colorization. The system distinguishes itself through a combination of latent-space domain mapping and progressive face enhancement to recover blurred or missing high-frequency facial details. For video content, it employs a colorization framework that uses optical flow and temporal guidance to propagate color from selected keyframes

This project is a command-line tool designed for image super-resolution and noise reduction, with a primary focus on anime-style illustrations. It utilizes convolutional neural network inference to reconstruct missing pixel data and remove digital artifacts, allowing users to upscale images and reduce noise either independently or in a single simultaneous processing pass. Beyond its core image restoration capabilities, the software provides a comprehensive suite for machine learning model training. Users can prepare custom datasets and optimize neural networks for specific restoration tasks,

RestorePhotos is an AI face restoration tool and deep learning image upscaler designed to remove blur and reconstruct lost details in degraded facial photographs. It functions as a face photo enhancer and a generative adversarial network image processor that transforms low-quality pixels into high-resolution facial features. The system utilizes a GPU-accelerated inference engine to run machine learning models for real-time image restoration. This hardware acceleration supports the heavy matrix multiplications and tensor-based operations required to sharpen facial images and improve visual fid

Pulse is a generative model image upscaler and latent space image processor. It functions as a self-supervised photo upsampling tool that increases image resolution by exploring the latent space of pre-trained generative models to synthesize high-quality details. The system includes a face image alignment tool designed to standardize the scale and orientation of raw facial photos. This preprocessing utility prepares images for higher resolution processing by aligning and downscaling faces to a standard orientation. The project covers AI image super-resolution and generative photo upscaling,

This project is an AI upscaling framework and deep learning image restorer designed to estimate original source pixels from low-resolution inputs. It functions as a super-resolution reconstruction system that transforms pixelated images into high-resolution versions by restoring high-frequency details and sharpening edges. The system utilizes a convolutional neural network pipeline to analyze pixel data and perform digital image restoration. It employs pixel-shuffle upsampling to rearrange channel dimensions into spatial dimensions, which increases resolution while reducing checkerboard artif

waifu2x-ncnn-vulkan is an AI super-resolution tool and image processor that uses deep learning to increase image resolution and remove visual noise. It is an NCNN-based implementation designed for efficient neural network inference on local hardware. The project utilizes the Vulkan API to provide GPU-accelerated image scaling and noise reduction across diverse graphics hardware. It employs tiled image processing to prevent GPU memory overflow and multi-threaded model loading to reduce initial startup latency. The software covers functional domains including AI image upscaling for maintaining

Final2x is an AI image super-resolution tool and neural network inference engine designed to increase image resolution and reconstruct missing details while reducing noise. It functions as a cross-platform image upscaler that executes consistent super-resolution logic across different operating systems. The project serves as a custom model inference engine and upscaling interface, allowing for the import and application of user-defined super-resolution weights and architectures to tailor the visual output of enlarged images. The system utilizes hardware-accelerated processing to offload comp

This project is an unsupervised image restoration tool that uses a convolutional neural network as a structural prior to reconstruct images from noisy or incomplete data. It functions as a neural network image prior, utilizing the inherent biases of the network architecture to restore pixels without the need for a pre-trained dataset or external learning. The system performs zero-shot image restoration by treating the network architecture itself as a regularization term. It uses a randomly initialized encoder-decoder structure and iterative gradient descent to minimize pixel-wise loss, recove

ESRGAN is a deep learning image restoration framework designed for image super-resolution. It uses a generative adversarial network system to upscale low-resolution images into high-quality versions with sharp visual details and recovered fine textures. The framework implements a perceptual super-resolution model that optimizes the trade-off between perceived visual quality and pixel-level signal-to-noise ratio. It includes weight-interpolation blending to allow for the adjustment of visual sharpness and signal-to-noise ratios by mixing weights from different trained models. The system cover

Real-ESRGAN is a deep learning restoration pipeline designed to enhance low-resolution media and improve the visual quality of damaged photographs. It functions as a generative image upscaler that reconstructs high-resolution details from source inputs by utilizing neural networks trained to fill in missing information and remove noise. The project distinguishes itself as a blind super-resolution tool, meaning it improves image sharpness and fidelity without requiring prior knowledge of the specific degradation applied to the source. It employs high-order degradation modeling to address compl

SwinIR is a deep learning image restoration framework that uses Swin Transformer architectures to recover image quality. It is designed to restore degraded images by removing noise, blur, and compression artifacts while increasing pixel density. The model provides specialized capabilities for image super-resolution, image denoising, and image deblurring. It also includes a dedicated tool for the removal of JPEG compression artifacts to restore visual quality lost during encoding. The system focuses on improving overall visual fidelity through resolution upscaling, noise removal, and the reco

Lama Cleaner is an AI-powered image editing application focused on inpainting, object removal, and generative filling. It provides a suite of tools for erasing unwanted elements from photos and filling the resulting gaps using generative artificial intelligence. The project includes specialized capabilities for image outpainting to extend borders, background removal through object segmentation, and face restoration to fix visual defects. It also features an image upscaler to increase resolution and clarity via super-resolution AI, as well as a Stable Diffusion-based editor for replacing speci

This project is a deep learning library built for single-image super-resolution and visual enhancement. It provides a framework for training and deploying neural network architectures designed to reconstruct high-resolution images from low-resolution sources, effectively recovering fine details and removing artifacts caused by downscaling or compression. The library distinguishes itself through the implementation of generative adversarial networks and residual block architectures, which work together to improve the realism and clarity of upscaled outputs. It supports training through both pix

IOPaint is an AI image editor and Stable Diffusion inpainting tool providing a web interface for removing objects and replacing image content. It utilizes latent diffusion image processing to synthesize high-resolution replacements for erased sections of an image. The project features a specialized AI background remover for isolating subjects and an AI image upscaler that employs super-resolution models for general photos and anime artwork. The software covers a broad range of capabilities including image segmentation for object isolation, face restoration for improving facial details, and t

Lama is an image restoration framework and deep learning model designed for image inpainting and object removal. It provides the tools necessary to train and evaluate neural networks that fill masked areas and repair corrupted visual data. The system utilizes a Fourier convolution neural network to maintain global image structure and reconstruct periodic patterns. This architecture allows for resolution-independent inference, enabling the processing of high-resolution images without increasing memory or computational requirements. The project includes a synthetic dataset generator that creat

Clarity-upscaler is an AI image upscaler and enhancement tool that uses deep learning models to increase image resolution and restore visual detail. It functions as a super-resolution inference engine that employs neural networks to predict missing pixels and synthesize high-frequency details from low-resolution sources. The project is delivered as a programmable API, allowing the integration of automated high-resolution image processing and sharpening into external applications and workflows. This interface enables the programmatic upscaling of images to create high-resolution assets. The s

This PyTorch-based image super-resolution tool provides a deep learning pipeline for upscaling low-resolution images. It utilizes generative adversarial networks to increase pixel density and reconstruct high-resolution image details. The system includes a GAN-based image upscaler and a training pipeline that optimizes neural network weights using paired datasets and custom loss functions. To manage hardware resources, a patch-based image processor splits high-resolution files into smaller segments to prevent memory allocation errors and system crashes. Additional capabilities include the ap

Srez is a deep learning image super-resolution framework designed to upscale low-resolution images into sharp, high-resolution visual features. It functions as a neural network training tool that employs generative adversarial networks to synthesize realistic image details. The project includes a model evolution visualizer that generates animations and image batches to track visual improvements during the training process. It utilizes a combination of adversarial and L1 loss functions to optimize model weights and supports periodic state checkpointing for recovery and deployment. The system

BasicSR is a PyTorch-based image restoration toolbox and framework designed for training and deploying deep learning models to upscale, denoise, and deblur images and videos. It serves as a comprehensive system for image super-resolution and video quality restoration, providing the necessary infrastructure to recover fine visual details and increase pixel density. The project distinguishes itself through specialized toolkits for facial image enhancement and high-fidelity face synthesis, as well as a dedicated video quality restoration suite that utilizes deformable convolutions and generative

Neural Enhance is a deep learning image upscaler and restoration tool designed to increase image resolution and remove blur. It functions as a neural image restoration utility for eliminating noise and JPEG artifacts, and includes a framework for training and tuning custom neural network models against image datasets. The system utilizes a containerized environment to offload tensor calculations to GPU cores, speeding up neural network inference. It features a batch processing pipeline that queues multiple image files in sequence to maximize hardware throughput. Capabilities include domain-s

Upscayl is a cross-platform desktop application designed to increase the resolution and visual quality of digital images using artificial intelligence. By executing all processing tasks locally on the user's machine, the software ensures that sensitive media files remain private and never leave the host system for cloud-based services. The application distinguishes itself through a hardware-agnostic architecture that offloads intensive rendering workloads directly to the local graphics unit. It utilizes a hardware abstraction layer to translate enhancement commands into instructions compatibl

Ziwei Luo, Fredrik K. Gustafsson, Zheng Zhao, Jens Sjölund, Thomas B. Schön Department of Information Technology, Uppsala University

Project Page | Paper | Model Card 🤗

The state-of-the-art image restoration model without nonlinear activation functions.

CVPR 2021 Multi-Stage Progressive Image Restoration. SOTA results for Image deblurring, deraining, and denoising.

mmagic is a multimodal training pipeline and framework for generative AI, focusing on visual synthesis and restoration. It provides the infrastructure to build and train models for tasks such as text-to-image and text-to-video generation, 3D-aware content synthesis, and high-fidelity image translation using diffusion models and generative adversarial networks. The project distinguishes itself through specialized capabilities for generative model personalization, including techniques for fine-tuning subjects and styles. It also supports advanced visual manipulations such as latent space interp