61 repository-uri
Frameworks and tools for training and deploying models that perform image-to-image translation and generative synthesis.
Distinguishing note: Focuses on the training and evaluation of generative image translation models rather than general-purpose computer vision or image processing.
Explore 61 awesome GitHub repositories matching artificial intelligence & ml · Generative Image Models. Refine with filters or upvote what's useful.
ComfyUI is a modular generative AI workflow orchestrator and node-based GUI for designing and executing complex diffusion model pipelines. It functions as both a visual interface for building generative logic graphs and a programmable backend API that exposes diffusion model operations for external integration. The system distinguishes itself through a graph-based execution model that supports differential workflow execution, re-running only modified nodes to reduce computation. It features dynamic model offloading to manage memory between system RAM and GPU VRAM and utilizes metadata-embedde
Transforms an existing image into a new version by encoding the source and processing it through a diffusion model.
This project is a deep learning framework designed for training and deploying image-to-image translation models. It serves as a research platform for experimenting with neural network architectures that transform visual content between distinct stylistic domains, supporting both paired and unpaired training data. The framework distinguishes itself through its support for cycle-consistency constraints, which allow for image translation between domains without requiring corresponding paired examples. It provides a structured pipeline that utilizes adversarial loss optimization, where generator
Provides specialized training pipelines for generative image-to-image translation models using paired datasets.
PyTorch-GAN is a research-oriented framework providing a collection of modular implementations for generative adversarial network architectures. It serves as a toolkit for training and evaluating models that utilize adversarial minimax optimization to produce synthetic data, offering a structured environment for exploring complex generative tasks within the PyTorch ecosystem. The library distinguishes itself through a comprehensive suite of image synthesis and manipulation capabilities, including super-resolution, inpainting, and cross-domain style translation. It supports advanced training m
The library trains neural networks to produce realistic data samples by pitting a generator against a discriminator in a competitive adversarial learning process.
This project is a generative adversarial network designed for image animation and motion transfer. It functions as a computer vision framework that synthesizes video sequences by applying motion patterns extracted from a driving video onto a static source image. The model distinguishes itself by using a keypoint-based representation to decouple object appearance from temporal movement. By tracking structural deformations through learned latent coordinates, it performs motion retargeting and synthetic media production without requiring manual annotations or object-specific training data. The
Transfers motion patterns from a driving video onto a static source image to generate realistic video sequences.
InstantID is a diffusion-based identity preservation framework designed for zero-shot image generation. It allows for the synthesis of images featuring a specific person's facial identity using a single reference photo without requiring additional model training or fine-tuning. The project distinguishes itself through the use of consistency model distillation to accelerate inference, reducing the number of steps needed to produce high-quality results. It combines identity-preserving feature extraction with multi-modal prompt integration to merge visual embeddings from a reference image with t
Creates images that synthesize a specific person's appearance within detailed, text-described environments.
Z-Image is an AI image editing engine and generation framework designed for photorealistic synthesis and the refinement of diffusion models. It functions as a multilingual text-to-image renderer and a system for training custom foundation models to generate and edit visuals using natural language instructions. The project distinguishes itself through a reasoning-based prompt enhancer that expands simple descriptions into detailed visual instructions using a structured reasoning chain. It also features specialized capabilities for rendering high-quality Chinese and English typography within ge
Serves as a framework for training custom foundation models to generate and edit photorealistic images.
This is a PyTorch implementation of a text-to-image model designed for synthesizing high-fidelity images from natural language descriptions. It utilizes a diffusion image generator to transform latent embeddings into visual data through an iterative denoising process. The system employs a two-stage latent mapping process, using a CLIP-based latent prior to map text embeddings to image embeddings before decoding them into pixels. It features a cascading diffusion decoder that produces high-resolution imagery by passing low-resolution outputs through a sequence of models at increasing scales.
Supports the creation of images without text conditioning by sampling from a standalone diffusion model.
This project is a static educational website and comprehensive curriculum focused on computer vision and deep learning. It serves as a public repository of instructional materials, lecture notes, and technical guides specifically detailing convolutional neural networks and visual recognition. The site is developed using static-site generation to host course documentation and student project directories. It provides structured academic resources that guide learners through image classification, generative modeling, and the implementation of various neural network architectures. The curriculum
Explains the use of masked convolutions to predict multiple image pixels simultaneously.
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
Trains a diffusion model on images and generates new images by reversing the noise process.
PhotoMaker is a diffusion-based identity generator designed for person-specific image synthesis. It creates high-fidelity photos and avatars of specific individuals using stacked embeddings, which allows for the generation of consistent human identities without the need for custom model training or fine-tuning. The system utilizes zero-shot identity synthesis and identity adapters to maintain recognizable facial features across various visual contexts. It supports artistic style transfer by combining identity information with specialized model weights and integrates external control framework
Generates high-fidelity images of specific human identities using stacked embeddings without requiring custom model training.
Neural Doodle is a collection of neural network tools designed for image upscaling, texture synthesis, and semantic-guided style transfer between visual inputs. It provides a semantic style transfer engine and an example-based image upscaler that increase image resolution by referencing visual details from a target style example. The project includes a neural texture synthesizer for creating seamless bitmap textures and repeating patterns from a single input style image. It also functions as an image generation tool capable of transforming simple sketches and photos into detailed artwork. Th
Uses generative image models to transform simple sketches and photos into detailed artwork and textures.
GroundingDINO is a deep learning vision model and open-vocabulary object detector designed to map natural language prompts to spatial coordinates. It functions as a text-to-bounding-box framework that enables zero-shot image localization, allowing the system to identify and locate arbitrary objects without requiring predefined classes or specific training for those categories. The project distinguishes itself by matching visual features to natural language descriptions to achieve open-set visual recognition. It supports text-guided image localization and the isolation of specific objects base
Integrates spatial coordinates with generative models to enable targeted and controllable image region editing.
Facechain is a generative AI toolchain and portrait generator designed to create personalized synthetic identities and consistent digital portraits. It provides a pipeline for training and refining diffusion models to produce subject-driven image synthesis from reference photos. The project focuses on digital twin generation, enabling the creation of a personalized model from a single image to maintain identity consistency across various poses and artistic styles. It utilizes identity fusion and similarity sorting to balance facial accuracy with stylized visual effects. The toolkit covers a
Generates a personalized image model from a single photo to create synthetic images of a specific person.
VAR is a visual autoregressive model and image generation framework that applies large language model scaling laws to visual data. It functions as an image generator that uses a coarse-to-fine next-scale prediction approach rather than traditional raster-scan tokenization. The system utilizes scale-based tokenization to represent images as a hierarchy of discrete tokens. It generates high-resolution content by iteratively predicting the next resolution level, refining coarse predictions into fine-grained details. The project covers a broad range of capabilities including autoregressive image
Generates images by iteratively increasing resolution through a sequence of increasingly detailed scale predictions.
This is a PyTorch-based implementation of diffusion models for synthesizing photorealistic images and video. It provides a framework for text-to-image and text-to-video generation, as well as unconditional image synthesis. The system utilizes a cascading diffusion pipeline to produce high-resolution imagery by passing low-resolution outputs through a sequence of super-resolution models. It also includes capabilities for image inpainting, allowing the reconstruction of masked or missing regions of visual media guided by surrounding context and text prompts. The project includes tools for diff
Synthesizes photorealistic images by reversing a Gaussian noise process guided by text embeddings.
Sana is a framework for high-resolution image and video synthesis based on a linear diffusion transformer. It provides a toolkit for the training, fine-tuning, and execution of text-to-image and text-to-video models, as well as a video generative world model capable of simulating physical environments with precise spatial control. The project is distinguished by its use of linear complexity layers to handle high resolutions and its support for long-form, minute-length video generation in real time. It implements a two-stage inference paradigm that separates structural generation from visual t
Implements adaptation training to specialize text-to-image models on specific subjects using a small set of reference images.
BasicSR is a PyTorch-based image restoration toolbox and framework designed for training and deploying deep learning models to upscale, denoise, and deblur images and videos. It serves as a comprehensive system for image super-resolution and video quality restoration, providing the necessary infrastructure to recover fine visual details and increase pixel density. The project distinguishes itself through specialized toolkits for facial image enhancement and high-fidelity face synthesis, as well as a dedicated video quality restoration suite that utilizes deformable convolutions and generative
Provides frameworks for training and deploying generative image models that support noise mixing for high-fidelity synthesis.
Pulse is a face image super-resolution tool and self-supervised image enhancer. It functions as a generative model image upsampler and latent space optimization tool designed to increase photo resolution and recover image details. The system differentiates itself by using latent space exploration and spherical constraints to find high-fidelity matches within a generative model. It employs geodesic distance measurement and spherical latent space optimization to regularize representations and maintain parameter radii during the recovery process. The project covers facial image restoration thro
Increases photo resolution by exploring the latent space of generative models for high-fidelity matches.
This project is a Dreambooth implementation designed to personalize Stable Diffusion models. It serves as an AI image personalization tool and model tuner that enables the creation of unique subject identifiers to generate consistent, personalized images. The system focuses on subject-driven image synthesis by fine-tuning pre-trained diffusion models on small, custom datasets. This allows the model to recognize specific people, objects, or artistic styles and place those learned subjects into diverse contexts via text-to-image conditioning. The implementation includes a diffusion model optim
Provides a complete system for creating unique subject identifiers to generate consistent, personalized images.
Omost is a system of software components designed for iterative image refinement, regional layout control, and the optimization of text-to-image embedding processes. It functions as a diffusion model layout controller and an engine that uses large language models to generate executable code for precise control over image composition. The project features a conversational image editor that allows for the refinement of visual content through natural language instructions and automated code execution. It distinguishes itself through a text embedding optimizer that organizes sub-prompts into tree
Uses an LLM to generate executable code for precise control over image bounding boxes and composition.