How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Videocrafter is a latent diffusion model designed for AI video synthesis. It functions as both a text-to-video and image-to-video generation system, synthesizing high-quality video sequences from descriptive text prompts or static image inputs. The model utilizes a diffusion-based neural network to transform inputs into animated content, ensuring visual consistency and temporal coherence throughout the generated sequences. This allows for the creation of custom video clips and the animation of static images into fluid motion.
ComfyUI-LTXVideo is a generative framework and ComfyUI custom node extension for synthesizing high-fidelity video. It utilizes a latent diffusion and transformer-based system to create cinematic clips from text, image, and audio inputs, providing a modular interface for precise control over subject behavior and temporal consistency. The tool distinguishes itself with production-grade capabilities, including the generation of High Dynamic Range video in linear formats such as ARRI LogC3. It supports multimodal synchronization for audio-driven animation and lip-syncing, and allows for the creat
StoryDiffusion is a generative AI system designed for consistent character image and video generation. It utilizes a pluggable cross-attention module to inject shared character representations into pretrained diffusion models, allowing for visual identity stability across multiple images and scenes without retraining the base model. The project features a video generation pipeline that produces temporally coherent sequences from text prompts or condition images. It employs a latent space motion interpolator to predict intermediate frames and semantic motion, enabling long-range video generati
EchoMimic is a multimodal human animation framework and diffusion-based video generator. It produces lifelike facial and semi-body animations of a reference image by synthesizing motion and appearance from various source data. The system enables portrait animation driven by audio, pose sequences, or driver videos. It features a landmark conditioning tool that allows for the precise control of facial movements by modifying specific landmark points. The framework covers multi-modal motion synthesis and the synchronization of reference images to match the physical movements of a target driver.
Stable-Video-Infinity is a video synthesis tool based on Stable Video Diffusion designed for creating long-form animations and consistent visual content. It serves as an AI video extension framework and a conditioned animation synthesizer capable of producing video sequences of arbitrary length.
The main features of vita-epfl/stable-video-infinity are: Video Diffusion Models, Video Synthesis, Multi-Modal Conditioned Synthesis, Residual Recycling Loops, Motion Conditioning, Arbitrary Duration Video Generators, Infinite-Length Generators, Long-form Generation.
Projects with overlapping indexed features include: ailab-cvc/videocrafter — Videocrafter is a latent diffusion model designed for AI video synthesis. It functions as both a text-to-video and… lightricks/comfyui-ltxvideo — ComfyUI-LTXVideo is a generative framework and ComfyUI custom node extension for synthesizing high-fidelity video. It… hvision-nku/storydiffusion — StoryDiffusion is a generative AI system designed for consistent character image and video generation. It utilizes a… meituan-longcat/longcat-video — LongCat-Video is a collection of specialized models for video synthesis, featuring a large language model based… antgroup/echomimic — EchoMimic is a multimodal human animation framework and diffusion-based video generator. It produces lifelike facial… picsart-ai-research/text2video-zero — Text2Video-Zero is a text-to-video diffusion model and framework designed to synthesize temporally consistent video…