pkuliyi2015/multidiffusion-upscaler-for-automatic1111
Multidiffusion Upscaler For Automatic1111
This project is an AI image upscaling and high-resolution generation tool. It uses tiled diffusion to create ultra-large images by processing them in smaller, overlapping regions to prevent memory crashes on limited hardware.
The system manages spatial composition through regional prompting, which routes specific text prompts to designated areas of an image. It maintains visual stability and global coherence during the upscaling process using noise inversion and structural guidance.
Additional capabilities include tiled detail upscaling and memory optimization for the variational autoencoder encoding and decoding stages. These features reduce the peak memory required for high-resolution image reconstruction.
Features
- Tiled Processing - Uses tiled processing to split large image generations into overlapping regions, preventing video memory overflow.
- Tiled Decoding - Processes the variational autoencoder stage in small tiles to reduce peak memory during high-resolution reconstruction.
- Tiled Latent Processing - Implements latent space tiling to enable the generation of ultra-large images without memory crashes.
- High-Resolution Synthesis - Generates ultra-large, high-fidelity synthetic images by processing them in smaller tiles to prevent hardware crashes.
- Tiled Synthesis - Creates ultra-large images from scratch using tiled diffusion and memory optimization.
- Noise Inversion Techniques - Provides noise inversion on individual tiles to ensure visual stability and coherence during the upscaling process.
- Guided Tiling - Combines tiled generation with external spatial maps to maintain global composition across multiple local processing tiles.
- Tiled Upscaling - Increases image resolution and detail using a tile-based refinement process to maintain quality at scale.
- VAE Memory Optimizations - Reduces peak memory consumption by processing the VAE encoding and decoding stages in small tiles.
- Composition-Controlled Generators - Employs structural guides and tiled generation to manage the precise layout and composition of high-resolution outputs.
- Regional Prompting - Allows assigning specific prompts to different designated areas of an image to control local composition.
- Detail Refinement - Iteratively processes overlapping image segments to add high-resolution details without memory overflow.
- Consistency Inversion - Performs noise inversion on tiles to maintain visual consistency during high-resolution processing.
