How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
CogVideo is a generative video framework that uses diffusion models and transformer-based architectures to synthesize high-resolution video clips. It functions as both a text-to-video and image-to-video generator, converting textual descriptions or static images into temporal visual sequences. The system integrates large language model capabilities to expand short user prompts into detailed descriptions for better visual alignment. It supports the animation of static images through latent seeding and provides the ability to extend the length of existing video sequences. The project includes
Open-Sora-Plan is a text-to-video framework and distributed video training system. It utilizes a diffusion transformer architecture and large language model components to transform written descriptions or image prompts into high-quality video sequences. The system features a distributed infrastructure designed for large-scale video training and inference. It employs sequence parallelism to split high-resolution or long-duration video samples across multiple GPUs and uses a sparse attention mechanism to increase processing speed. The project includes capabilities for both text-to-video and im
AnimateDiff is a latent diffusion video generator and text-to-video diffusion framework. It converts existing text-to-image diffusion models into animation generators by applying specialized motion modules, allowing for the creation of video sequences without modifying the original base model. The project provides an image-to-video animation framework that uses sparse RGB images, sketches, or structural keyframe constraints to guide generation. It further distinguishes itself with a motion adapter system that injects cinematic camera movements, such as zooming, panning, and tilting, into anim
StoryDiffusion is a generative AI system designed for consistent character image and video generation. It utilizes a pluggable cross-attention module to inject shared character representations into pretrained diffusion models, allowing for visual identity stability across multiple images and scenes without retraining the base model. The project features a video generation pipeline that produces temporally coherent sequences from text prompts or condition images. It employs a latent space motion interpolator to predict intermediate frames and semantic motion, enabling long-range video generati
I've made everythign less reliant on torch.compile for VRAM efficiency, so things should work better even without it. Also figured workaround for some issues when using compile that made first run use drastically more VRAM, issue I battled with myself a lot.
The main features of kijai/comfyui-wanvideowrapper are: Video Generation Node Suites, Text-to-Video Generators, Video, Image-to-Video Generation, VRAM-Constrained Generators, Transformer Block Offloaders, Overlapping Window Extenders, Overlapping Window Generators.
Projects with overlapping indexed features include: thudm/cogvideo — CogVideo is a generative video framework that uses diffusion models and transformer-based architectures to synthesize… tencent-hunyuan/hunyuanvideo-1.5 — HunyuanVideo-1.5 is a video generation foundation model and text-to-video diffusion framework. It utilizes a latent… hvision-nku/storydiffusion — StoryDiffusion is a generative AI system designed for consistent character image and video generation. It utilizes a… guoyww/animatediff — AnimateDiff is a latent diffusion video generator and text-to-video diffusion framework. It converts existing… sandai-org/magi-1 — MAGI-1 is an autoregressive video generation model designed to synthesize high-resolution video sequences from text… pku-yuangroup/open-sora-plan — Open-Sora-Plan is a text-to-video framework and distributed video training system. It utilizes a diffusion transformer…