# yuyuyzl/easyvtuber

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/yuyuyzl-easyvtuber).**

2,690 stars · 258 forks · Python · mit

## Links

- GitHub: https://github.com/yuyuyzl/EasyVtuber
- awesome-repositories: https://awesome-repositories.com/repository/yuyuyzl-easyvtuber.md

## Description

EasyVtuber is 2D avatar animation software that transforms a single static image into a real-time animated character. It functions as a face tracking animation tool and live streaming avatar driver, mapping facial movements from webcams or iOS devices to drive virtual expressions and head motion.

The project distinguishes itself through a neural animation pipeline that includes AI video upscaling and frame interpolation to increase visual smoothness and resolution. It utilizes a transparent video streaming system via Spout2, allowing rendered frames with alpha channels to be sent directly to broadcasting software without the use of green screens.

The software covers a broad range of capabilities, including face tracking integration for depth sensors and webcams, audio-driven motion simulation for lip-syncing and blinking, and performance optimizations such as pose calculation caching and hardware-accelerated inference.

## Tags

### Graphics & Multimedia

- [2D Avatar Animation Software](https://awesome-repositories.com/f/graphics-multimedia/2d-avatar-animation-software.md) — Provides a complete system to transform static images into real-time animated characters using face tracking and AI.
- [Image-to-Video Animators](https://awesome-repositories.com/f/graphics-multimedia/image-editing-processing/image-processing/image-sequence-processors/animation-frame-sequencers/generative-animation-sequences/image-to-video-animators.md) — Transforms a single static image into an animated talking head using motion transfer from tracking data.
- [AI Avatar Streaming Bridges](https://awesome-repositories.com/f/graphics-multimedia/ai-avatar-streaming-bridges.md) — Synchronizes mouth movements and blinking using microphone audio and camera input for live streaming.
- [Human Motion Synthesis](https://awesome-repositories.com/f/graphics-multimedia/animation-motion/animal-motion-synthesis/human-motion-synthesis.md) — Generates naturalistic facial and head movements driven by real-time audio input.
- [Audio-Reactive Avatars](https://awesome-repositories.com/f/graphics-multimedia/audio-music/terminal-based-audio-playback/audio-visualizers/audio-reactive-avatars.md) — Generates automatic blinking, breathing, and mouth movements synchronized to microphone audio. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [GPU Texture Sharing](https://awesome-repositories.com/f/graphics-multimedia/gpu-texture-sharing.md) — Uses Spout2 to send rendered avatar frames with alpha channels directly to broadcasting software.
- [Real-Time 2D Avatar Animation](https://awesome-repositories.com/f/graphics-multimedia/real-time-2d-avatar-animation.md) — Drives a static character image using live facial expressions and head motion to create a virtual persona. ([source](https://github.com/yuyuyzl/EasyVtuber/blob/main/.gitignore))
- [Real-Time Motion Tracking](https://awesome-repositories.com/f/graphics-multimedia/real-time-motion-tracking.md) — Processes video frames in real time to track facial movements and map them to an avatar. ([source](https://github.com/yuyuyzl/EasyVtuber/blob/main/00B.Spout2%E6%8F%92%E4%BB%B6.url))
- [Virtual YouTuber Tools](https://awesome-repositories.com/f/graphics-multimedia/virtual-youtuber-tools.md) — Facilitates the entire workflow of mapping facial data to a 2D avatar for live streaming as a VTuber.
- [Broadcast Software Integration](https://awesome-repositories.com/f/graphics-multimedia/broadcast-software-integration.md) — Streams rendered avatar data to external software with transparency support via Spout2. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [AI Upscaling](https://awesome-repositories.com/f/graphics-multimedia/image-editing-processing/image-enhancement-tools/ai-upscaling.md) — Implements AI-driven resolution upscaling to sharpen rendered avatar frames for higher clarity.
- [Live Broadcast Integrations](https://awesome-repositories.com/f/graphics-multimedia/live-broadcast-integrations.md) — Exports the rendered avatar as a virtual camera or video source for use in broadcast tools. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [Depth Data Capture](https://awesome-repositories.com/f/graphics-multimedia/media-capture-utilities/depth-data-capture.md) — Captures high-precision facial expression maps using iOS depth-sensing hardware. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [Live Video Broadcasting](https://awesome-repositories.com/f/graphics-multimedia/streaming-distribution/streaming-broadcasting/broadcasting-streaming/live-video-broadcasting.md) — Streams transparent avatar video to broadcasting software for seamless live video integration.
- [Alpha-Channel](https://awesome-repositories.com/f/graphics-multimedia/streaming-distribution/streaming-broadcasting/media-streaming/video-streaming/alpha-channel.md) — Sends the avatar with a native alpha channel to broadcasting software for transparent compositing. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [Transparent Video Streaming](https://awesome-repositories.com/f/graphics-multimedia/video-compositing/transparent-video-streaming.md) — Streams rendered frames with alpha transparency via Spout2 to eliminate the need for green screens.

### Artificial Intelligence & ML

- [Facial Feature Tracking](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/computer-vision/development-orchestration-tools/computer-vision-libraries/camera-tracking/facial-feature-tracking.md) — Captures facial movements using standard USB webcams with configurable tracking precision. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))
- [Face Tracking](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/computer-vision/facial-analysis-systems/face-tracking.md) — Integrates webcams and iOS depth sensors to capture facial coordinates for avatar control.
- [Facial Animation](https://awesome-repositories.com/f/artificial-intelligence-ml/facial-animation.md) — Maps facial movements from webcams and iOS devices onto digital character models in real time.
- [Audio-Driven Talking Head Synthesis](https://awesome-repositories.com/f/artificial-intelligence-ml/video-generation/image-to-video-generation/audio-driven-talking-head-synthesis.md) — Uses machine learning to synthesize lip sync and head movements from audio and camera data.
- [Frame Interpolation Networks](https://awesome-repositories.com/f/artificial-intelligence-ml/cuda-accelerated-neural-networks/frame-interpolation-networks.md) — Implements a neural network to predict and insert intermediate frames for smoother avatar motion.
- [Video Super-Resolution Suites](https://awesome-repositories.com/f/artificial-intelligence-ml/image-super-resolution-models/video-super-resolution-suites.md) — Employs super-resolution AI models to upscale and sharpen rendered avatar frames.
- [Pose Calculation Caching](https://awesome-repositories.com/f/artificial-intelligence-ml/spatial-pose-management/pose-optimization/pose-calculation-caching.md) — Reduces GPU load by caching and reusing rendered frames for matching facial poses.

### User Interface & Experience

- [Frame Interpolation Engines](https://awesome-repositories.com/f/user-interface-experience/animation-and-motion-systems/configuration-utility-helpers/animation-configuration/frame-execution-synchronization/animation-frame-rate-controls/frame-interpolation-engines.md) — Generates synthetic intermediate frames to increase output frame rate and motion smoothness. ([source](https://github.com/yuyuyzl/EasyVtuber#readme))