1 repositorio
Generates intermediate frames by denoising a latent representation conditioned on start and end frames using a pretrained diffusion model.
Distinct from Video Diffusion Models: Distinct from Video Diffusion Models: specifically conditions on start and end frames for interpolation rather than generating from noise.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Conditioned Frame Interpolators. Refine with filters or upvote what's useful.
ToonCrafter is a model that combines latent diffusion, reference-based colorization, and sketch-guided control for cartoon animation and interpolation. It functions as a cartoon video interpolation model, a reference-based colorization model, and a sketch-guided animation tool, all built on a latent diffusion animation framework. The project distinguishes itself by integrating three core capabilities into a single pipeline: generating smooth intermediate frames between two cartoon images using diffusion-based priors, transferring color and style from a reference image onto black-and-white ske
Generates intermediate frames by denoising a latent representation conditioned on start and end frames.