4 个仓库
Injecting skeletal and pose data as guidance signals into diffusion denoising processes.
Distinct from Diffusion Conditioning Architectures: Specializes general diffusion conditioning to the use of pose-based spatial signals.
Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Pose Conditioning. Refine with filters or upvote what's useful.
AnimateAnyone is an appearance-preserving video synthesizer designed for character animation from a single static image. It functions as a diffusion image-to-video generator that transforms a source image into a high-fidelity video sequence while maintaining consistent character identity, clothing, and visual details across all frames. The system enables video-driven character reenactment by transferring motions, facial expressions, and body movements from a reference video onto a static character. It employs pose-guided video generation to control movement via skeleton keypoints and pose sig
Uses spatially-aligned skeleton keypoints as conditioning signals to drive character movement during the denoising process.
EchoMimic V2 是一个 AI 视频生成流水线和计算机视觉动画模型,旨在生成合成的人体动画。它作为一个生成式框架,通过将静态参考图像与从驱动视频中提取的姿态动作对齐,来创建半身视频。 该系统利用基于扩散的生成过程,结合潜在空间压缩和时间注意力机制,以确保帧间平滑过渡。它通过基于参考的编码保持人物身份一致性,并通过姿态驱动的运动调节来引导空间位置。 该项目包含多阶段图像细化功能,以提高面部细节和清晰度。它还提供了动画数据集准备工具,包括将视频数据下载并预处理为模型训练和推理所需的格式。
Uses pose-based conditioning to guide the spatial placement and movement of the generated human figure.
Champ 是一个生成式视觉系统和可控的图像转视频生成器,专为人体图像动画设计。它使用基于扩散的视频合成器和 3D 参数化引导,将单张参考图像转换为基于外部驱动数据的连贯运动序列。 该框架通过人体姿态迁移系统脱颖而出,该系统采用 3D 人体参数提取和坐标空间对齐。这使得模型能够通过使用深度和语义条件图调整身体比例和摄像机视角,将驱动视频中的运动映射到参考人物身上。 该系统涵盖了广泛的功能,包括运动数据细化、参数化运动迁移以及两阶段视觉模型训练流水线。这些过程确保了生成的人体动画在结构上的一致性和时间上的稳定性。
Renders processed 3D body data into visual condition maps to guide the animation process.
ComfyUI-LTXVideo is a generative framework and ComfyUI custom node extension for synthesizing high-fidelity video. It utilizes a latent diffusion and transformer-based system to create cinematic clips from text, image, and audio inputs, providing a modular interface for precise control over subject behavior and temporal consistency. The tool distinguishes itself with production-grade capabilities, including the generation of High Dynamic Range video in linear formats such as ARRI LogC3. It supports multimodal synchronization for audio-driven animation and lip-syncing, and allows for the creat
Implements pose-conditioning layers to steer character movement and camera paths during video synthesis.