# sebastianstarke/ai4animation

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/sebastianstarke-ai4animation).**

8,774 stars · 1,139 forks · C++

## Links

- GitHub: https://github.com/sebastianstarke/AI4Animation
- awesome-repositories: https://awesome-repositories.com/repository/sebastianstarke-ai4animation.md

## Description

AI4Animation is a deep learning motion controller and framework for generating biped and quadruped locomotion from motion capture data. It provides a system for training and executing neural networks to drive real-time character animations within Unity.

The project features a neural animation blending system that synthesizes novel movements by mixing unaligned motion sources using learned manifolds. It also includes a real-time inverse kinematics solver for computing joint positions based on target goals and scene geometry.

The toolset covers motion capture data processing, including the import and cleaning of FBX, BVH, GLB, and NPZ formats. It further supports manifold-based motion extraction to learn periodic spatial-temporal structures and sensor-to-motion mapping for translating sparse signals into full-body avatar movements.

## Tags

### Artificial Intelligence & ML

- [Motion Synthesis Models](https://awesome-repositories.com/f/artificial-intelligence-ml/motion-synthesis-models.md) — Provides a deep learning system to generate biped and quadruped locomotion from motion capture data.
- [Locomotion Training](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-training-tools/locomotion-training.md) — Provides a framework for training neural networks to generate biped and quadruped locomotion from motion capture data. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Neural Animation Drivers](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-animation-drivers.md) — Executes trained deep learning models within a game engine to generate character joint rotations based on real-time inputs.
- [Manifold-Based Motion Extraction](https://awesome-repositories.com/f/artificial-intelligence-ml/manifold-based-motion-extraction.md) — Learns periodic features and spatial-temporal structures from datasets to improve alignment and similarity measures for motion capture.
- [Motion Phase Manifold Extraction](https://awesome-repositories.com/f/artificial-intelligence-ml/motion-phase-manifold-extraction.md) — Learns periodic features and spatial-temporal structures from motion datasets to improve alignment and similarity measures. ([source](https://github.com/sebastianstarke/ai4animation#readme))

### Game Development

- [Neural Model Training](https://awesome-repositories.com/f/game-development/character-animation-runtimes/neural-model-training.md) — Provides a deep learning system for training neural networks that control the movement and behavior of biped and quadruped characters. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Character Animation Runtimes](https://awesome-repositories.com/f/game-development/character-animation-runtimes.md) — Executes trained neural networks within a game engine to drive real-time character animations based on inputs. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Inverse Kinematics Character Animations](https://awesome-repositories.com/f/game-development/character-animation-runtimes/inverse-kinematics-character-animations.md) — Implements a real-time system to compute joint positions for characters to reach target goals using inverse kinematics. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Neural Animation Runtimes](https://awesome-repositories.com/f/game-development/neural-animation-runtimes.md) — Provides a framework for executing trained neural networks to drive real-time character motion within Unity.
- [Data Processing Pipelines](https://awesome-repositories.com/f/game-development/tooling-asset-pipeline/motion-capture/data-processing-pipelines.md) — Implements a pipeline for importing and cleaning animation data from FBX and BVH formats for neural network training.
- [Environment-Adaptive Animations](https://awesome-repositories.com/f/game-development/environment-adaptive-animations.md) — Generates character movements that adapt to scene geometry for actions like sitting or obstacle avoidance. ([source](https://github.com/sebastianstarke/ai4animation#readme))

### Part of an Awesome List

- [Video and Motion Synthesis](https://awesome-repositories.com/f/awesome-lists/ai/video-and-motion-synthesis.md) — Trains deep learning models to generate biped and quadruped locomotion from raw motion capture data.
- [Inverse Kinematics](https://awesome-repositories.com/f/awesome-lists/devtools/inverse-kinematics.md) — Provides a real-time solver for computing joint configurations to reach specific target goals.

### Graphics & Multimedia

- [Neural Animation Blending](https://awesome-repositories.com/f/graphics-multimedia/media-production-suites/animation-tools/keyframe-skeletal-systems/animation-pipelines/runtime-animation-blending/neural-animation-blending.md) — Synthesizes novel movement combinations by imitating animation layering to mix and blend unaligned motion sources. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Motion Retargeting](https://awesome-repositories.com/f/graphics-multimedia/motion-retargeting.md) — Translates sparse sensor signals into full-body avatar motions in real-time while preserving original motion context. ([source](https://github.com/sebastianstarke/ai4animation#readme))
- [Imitative Layering](https://awesome-repositories.com/f/graphics-multimedia/skeletal-animation-blending/imitative-layering.md) — Synthesizes novel movement combinations by blending unaligned motion sources to simulate traditional animation layer mixing.
- [Neural Blending Systems](https://awesome-repositories.com/f/graphics-multimedia/skeletal-animation-blending/neural-blending-systems.md) — Synthesizes novel movements by mixing unaligned motion sources using learned manifolds.