facebookresearch/AnimatedDrawingsArchived
AnimatedDrawings
AnimatedDrawings is a system for transforming static 2D drawings of humanoid figures into animated characters. It provides a workflow for character rigging, motion mapping, and scene assembly to turn hand-drawn sketches into moving visual sequences.
The project utilizes a motion retargeting framework to map movement data from motion capture files onto custom character skeletons regardless of their physical proportions. It employs a rigging tool that uses pose estimation to automatically predict joint locations and create digital skeletons, which can be manually refined to improve animation accuracy.
The software covers a broad range of animation production capabilities, including pixel-based image warping to simulate fluid movement, skeleton-aware masking for character segmentation, and a scene composer for combining multiple animated figures with static backgrounds into final video files.
Features
- Image-to-Video Character Animation - Transforms static images of drawn human figures into moving characters by applying skeletal motion data.
- Automatic Pose Annotators - Automatically estimates the pose of drawn figures to generate the rigging files needed for animation.
- Pose Estimation Frameworks - Uses a computer vision model to predict joint locations on a static image for rigging setup.
- Motion Transfer Animators - Turns static images of hand-drawn human figures into animated characters using motion data.
- Image Warping Engines - Deforms drawing pixels based on the movement of the rigged skeleton to simulate fluid animation.
- 2D Skeletal Rigs - Maps a skeletal structure of joint points to a 2D image to define bending and stretching.
- Animation Retargeting - Translates movement data from source animation files to target skeletons with different proportions.
- Skeletal Rigging - Provides tools for estimating poses and creating digital skeletons to automate 2D drawing animation.
- Motion Retargeting - Maps movement from motion capture files to any character regardless of skeleton structure.
- Manual Mask Refinement - Provides a visual editor to manually correct automated joint predictions and image masks.
- Skeletal Structure Definitions - Allows the creation of non-standard skeletal structures for figures with extra limbs or quadrupedal bodies.
- Scene Compositing Tools - Combines multiple animated drawings and custom backgrounds into a final rendered video sequence.
- Animation Sequence Renderers - Produces animated sequences as interactive windows or video files via local or remote processing.
- Digital Art Animation Suites - Combines animated hand-drawn characters with background images to produce complete visual scenes.
- Scene Composition - Combines multiple animated characters and custom background images into a single video scene.
- Animation Layer Compositing - Organizes animated characters and static backgrounds into hierarchical layers for final video rendering.
- Pose-Aware Segmentation Masks - Segments characters from backgrounds by creating boundary masks that follow the predicted pose.
