Image-driven animation

AnimatedDrawings is a system for transforming static 2D drawings of humanoid figures into animated characters. It provides a workflow for character rigging, motion mapping, and scene assembly to turn hand-drawn sketches into moving visual sequences. The project utilizes a motion retargeting framework to map movement data from motion capture files onto custom character skeletons regardless of their physical proportions. It employs a rigging tool that uses pose estimation to automatically predict joint locations and create digital skeletons, which can be manually refined to improve animation ac

EchoMimic is a multimodal human animation framework and diffusion-based video generator. It produces lifelike facial and semi-body animations of a reference image by synthesizing motion and appearance from various source data. The system enables portrait animation driven by audio, pose sequences, or driver videos. It features a landmark conditioning tool that allows for the precise control of facial movements by modifying specific landmark points. The framework covers multi-modal motion synthesis and the synchronization of reference images to match the physical movements of a target driver.

LivePortrait is a computer vision framework designed for portrait animation and generative video synthesis. It functions as a deep learning system that transfers facial expressions and head movements from a driving video source onto a static image or an existing portrait video, effectively decoupling the subject's identity from the dynamic motion patterns. The framework utilizes keypoint-based motion retargeting and implicit 3D latent representations to map movements across different subjects, including both human and animal portraits. By employing canonical motion normalization and feature-s

CogVideo is a generative video framework that uses diffusion models and transformer-based architectures to synthesize high-resolution video clips. It functions as both a text-to-video and image-to-video generator, converting textual descriptions or static images into temporal visual sequences. The system integrates large language model capabilities to expand short user prompts into detailed descriptions for better visual alignment. It supports the animation of static images through latent seeding and provides the ability to extend the length of existing video sequences. The project includes

Videocrafter is a latent diffusion model designed for AI video synthesis. It functions as both a text-to-video and image-to-video generation system, synthesizing high-quality video sequences from descriptive text prompts or static image inputs. The model utilizes a diffusion-based neural network to transform inputs into animated content, ensuring visual consistency and temporal coherence throughout the generated sequences. This allows for the creation of custom video clips and the animation of static images into fluid motion.

AnimateAnyone is an appearance-preserving video synthesizer designed for character animation from a single static image. It functions as a diffusion image-to-video generator that transforms a source image into a high-fidelity video sequence while maintaining consistent character identity, clothing, and visual details across all frames. The system enables video-driven character reenactment by transferring motions, facial expressions, and body movements from a reference video onto a static character. It employs pose-guided video generation to control movement via skeleton keypoints and pose sig

AnimateDiff is a latent diffusion video generator and text-to-video diffusion framework. It converts existing text-to-image diffusion models into animation generators by applying specialized motion modules, allowing for the creation of video sequences without modifying the original base model. The project provides an image-to-video animation framework that uses sparse RGB images, sketches, or structural keyframe constraints to guide generation. It further distinguishes itself with a motion adapter system that injects cinematic camera movements, such as zooming, panning, and tilting, into anim

LiquidFun is a 2D physics engine and game physics framework designed to calculate movement and collisions for rigid bodies and particle systems. It functions as a simulation tool for integrating real-time physical interactions and dynamics into interactive applications. The framework specifically provides a particle-based fluid simulator to model liquid dynamics, including splashing, displacement, and surface tension. It also includes a soft body physics simulator for creating deformable and elastic objects that react to physical forces. The engine covers a broad range of physical interactio

Kalidokit is a web-based motion capture tool that transforms real-time webcam video into 3D character animation data. It functions as a blendshape and kinematics calculator, converting facial, hand, and body tracking data from Mediapipe and TensorFlow.js into blendshape weights and euler rotations for driving digital puppets and avatars. The tool solves face landmarks to derive head rotation, eye blinks, mouth shapes, and brow values for rigging, while hand landmarks are converted into finger joint rotations and body keypoints into per-joint euler rotations for full-body animation. It include

Crest is a GPU-accelerated fluid simulator and real-time ocean renderer developed as a plugin and simulation framework for the Unity game engine. It provides a system for generating high-fidelity ocean surfaces and wave dynamics for use in professional game development pipelines. The framework utilizes compute shaders and fast Fourier transforms to calculate water movement and wave synthesis. It manages large-scale water environments through the use of cascaded level-of-detail geometry and GPU-driven instancing to maintain performance across expansive scenes. The simulation surface is furthe

ammo.js is a JavaScript port of the Bullet physics engine, compiled via Emscripten to provide a high-performance physics library for the browser. It functions as a 3D rigid body engine and an Emscripten compiled library that enables complex physical computations using WebAssembly and JavaScript. The project provides specialized simulation capabilities for soft body physics, modeling the deformation of flexible materials like cloth and rubber, and a vehicle dynamics engine for calculating the mechanics of wheeled vehicles. The simulation surface also covers rigid body dynamics for non-deforma