facebookresearch/AnimatedDrawingsArchived
AnimatedDrawings
AnimatedDrawings is a system for transforming static 2D drawings of humanoid figures into animated characters. It provides a workflow for character rigging, motion mapping, and scene assembly to turn hand-drawn sketches into moving visual sequences.
The project utilizes a motion retargeting framework to map movement data from motion capture files onto custom character skeletons regardless of their physical proportions. It employs a rigging tool that uses pose estimation to automatically predict joint locations and create digital skeletons, which can be manually refined to improve animation accuracy.
The software covers a broad range of animation production capabilities, including pixel-based image warping to simulate fluid movement, skeleton-aware masking for character segmentation, and a scene composer for combining multiple animated figures with static backgrounds into final video files.
Features
- Image-to-Video Character Animation - Transforms static images of drawn human figures into moving characters by applying skeletal motion data.
- Automatic Pose Annotators - Automatically estimates the pose of drawn figures to generate the rigging files needed for animation.
- Pose Estimation Frameworks - Uses a computer vision model to predict joint locations on a static image for rigging setup.
- Motion Transfer Animators - Turns static images of hand-drawn human figures into animated characters using motion data.
- Image Warping Engines - Deforms drawing pixels based on the movement of the rigged skeleton to simulate fluid animation.
- 2D Skeletal Rigs - Maps a skeletal structure of joint points to a 2D image to define bending and stretching.
- Animation Retargeting - Translates movement data from source animation files to target skeletons with different proportions.
- Skeletal Rigging - Provides tools for estimating poses and creating digital skeletons to automate 2D drawing animation.
- Motion Retargeting - Maps movement from motion capture files to any character regardless of skeleton structure.
- Manual Mask Refinement - Provides a visual editor to manually correct automated joint predictions and image masks.
- Skeletal Structure Definitions - Allows the creation of non-standard skeletal structures for figures with extra limbs or quadrupedal bodies.
- Scene Compositing Tools - Combines multiple animated drawings and custom backgrounds into a final rendered video sequence.
- Animation Sequence Renderers - Produces animated sequences as interactive windows or video files via local or remote processing.
- Digital Art Animation Suites - Combines animated hand-drawn characters with background images to produce complete visual scenes.
- Scene Composition - Combines multiple animated characters and custom background images into a single video scene.
- Animation Layer Compositing - Organizes animated characters and static backgrounds into hierarchical layers for final video rendering.
- Pose-Aware Segmentation Masks - Segments characters from backgrounds by creating boundary masks that follow the predicted pose.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
