# AliaksandrSiarohin/first-order-model

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/aliaksandrsiarohin-first-order-model).**

15,003 stars · 3,284 forks · Jupyter Notebook · mit

## Links

- GitHub: https://github.com/AliaksandrSiarohin/first-order-model
- Homepage: https://aliaksandrsiarohin.github.io/first-order-model-website/
- awesome-repositories: https://awesome-repositories.com/repository/aliaksandrsiarohin-first-order-model.md

## Topics

`deep-learning` `generative-model` `image-animation` `motion-retargeting`

## Description

This project is a generative adversarial network designed for image animation and motion transfer. It functions as a computer vision framework that synthesizes video sequences by applying motion patterns extracted from a driving video onto a static source image.

The model distinguishes itself by using a keypoint-based representation to decouple object appearance from temporal movement. By tracking structural deformations through learned latent coordinates, it performs motion retargeting and synthetic media production without requiring manual annotations or object-specific training data.

The system utilizes dense motion field estimation and local affine transformations to warp source image features into target poses. Through an encoder-decoder architecture and adversarial training, it generates realistic video frames that map facial expressions and head movements from a source video onto a target subject.

## Tags

### Artificial Intelligence & ML

- [Portrait Animation Tools](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-video-generators/portrait-animation-tools.md) — Maps facial expressions and head movements from a source video onto a target image for synthetic media production.
- [Generative Adversarial Image Synthesis](https://awesome-repositories.com/f/artificial-intelligence-ml/image-super-resolution-models/generative-adversarial-image-synthesis.md) — Transfers motion patterns from a driving video onto a static source image to synthesize realistic video sequences.
- [Keypoint-Based Motion Transfer Models](https://awesome-repositories.com/f/artificial-intelligence-ml/keypoint-detection/keypoint-based-motion-transfer-models.md) — Decouples object appearance from movement by tracking structural deformations through learned latent keypoints.
- [Generative Adversarial Networks](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-adversarial-networks.md) — Synthesizes high-quality video frames by learning the underlying structure and motion dynamics of visual objects.
- [Portrait Video Retargeting](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/generative-ai-tasks/video-to-video-synthesis/portrait-video-retargeting.md) — Transfers complex movement sequences from one video source to another subject to animate characters or faces.
- [Generative Image Models](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-image-models.md) — Transfers motion patterns from a driving video onto a static source image to generate realistic video sequences.
- [Deepfake Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/deepfake-generation.md) — Maps facial expressions and head movements of a source person onto a target image to create realistic synthetic videos.
- [Keypoint-Based Motion Representations](https://awesome-repositories.com/f/artificial-intelligence-ml/representation-probing/implicit-latent-representations/keypoint-based-motion-representations.md) — Tracks structural deformations through learned latent coordinates to decouple object appearance from temporal movement patterns.
- [Unsupervised Motion Transfer Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/frameworks/computer-vision/unsupervised-motion-transfer-frameworks.md) — Performs unsupervised motion transfer and image manipulation tasks using deep learning models without manual annotations.
- [Synthetic Media Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/synthetic-content-generators/synthetic-media-generators.md) — Generates expressive video content from static assets for creative projects and digital avatars.
- [Dense Motion Field Estimators](https://awesome-repositories.com/f/artificial-intelligence-ml/vector-field-estimation/dense-motion-field-estimators.md) — Computes pixel-wise displacement vectors to align source image textures with the geometry of driving video frames.

### Graphics & Multimedia

- [Image-to-Video Animators](https://awesome-repositories.com/f/graphics-multimedia/image-editing-processing/image-processing/image-sequence-processors/animation-frame-sequencers/generative-animation-sequences/image-to-video-animators.md) — Generates video sequences by applying motion patterns from a driving video to a static source image. ([source](https://aliaksandrsiarohin.github.io/first-order-model-website/))
- [Portrait Animation Engines](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/face-portrait-manipulation/portrait-animation-engines.md) — Transforms a single static portrait into a moving video by applying motion patterns extracted from a driving video.