AnimatedDrawings

AnimatedDrawings is a system for transforming static 2D drawings of humanoid figures into animated characters. It provides a workflow for character rigging, motion mapping, and scene assembly to turn hand-drawn sketches into moving visual sequences.

The project utilizes a motion retargeting framework to map movement data from motion capture files onto custom character skeletons regardless of their physical proportions. It employs a rigging tool that uses pose estimation to automatically predict joint locations and create digital skeletons, which can be manually refined to improve animation accuracy.

The software covers a broad range of animation production capabilities, including pixel-based image warping to simulate fluid movement, skeleton-aware masking for character segmentation, and a scene composer for combining multiple animated figures with static backgrounds into final video files.

Features

Image-to-Video Character Animation - Transforms static images of drawn human figures into moving characters by applying skeletal motion data.

Automatic Pose Annotators - Automatically estimates the pose of drawn figures to generate the rigging files needed for animation.

Pose Estimation Frameworks - Uses a computer vision model to predict joint locations on a static image for rigging setup.

Motion Transfer Animators - Turns static images of hand-drawn human figures into animated characters using motion data.

Image Warping Engines - Deforms drawing pixels based on the movement of the rigged skeleton to simulate fluid animation.

2D Skeletal Rigs - Maps a skeletal structure of joint points to a 2D image to define bending and stretching.

Animation Retargeting - Translates movement data from source animation files to target skeletons with different proportions.

Skeletal Rigging - Provides tools for estimating poses and creating digital skeletons to automate 2D drawing animation.

Motion Retargeting - Maps movement from motion capture files to any character regardless of skeleton structure.

Manual Mask Refinement - Provides a visual editor to manually correct automated joint predictions and image masks.

Skeletal Structure Definitions - Allows the creation of non-standard skeletal structures for figures with extra limbs or quadrupedal bodies.

Scene Compositing Tools - Combines multiple animated drawings and custom backgrounds into a final rendered video sequence.

Animation Sequence Renderers - Produces animated sequences as interactive windows or video files via local or remote processing.

Digital Art Animation Suites - Combines animated hand-drawn characters with background images to produce complete visual scenes.

Scene Composition - Combines multiple animated characters and custom background images into a single video scene.

Animation Layer Compositing - Organizes animated characters and static backgrounds into hierarchical layers for final video rendering.

Pose-Aware Segmentation Masks - Segments characters from backgrounds by creating boundary masks that follow the predicted pose.

facebookresearchAnimatedDrawingsArchived

Features

Star history