InfiniteTalk is an open-source system for generating talking head videos driven by audio input. It synthesizes realistic lip movements, head poses, and facial expressions synchronized to a spoken audio track, using either a single still image or a small set of reference video frames as the visual source. The system can produce videos of arbitrary length while maintaining temporal coherence, and it supports animating multiple subjects in a single scene. A key differentiator is the ability to coordinate multiple talking subjects through a structured JSON description, giving each independent lip
Farzaneh Jafari, Stefano Berretti, Anup Basu
LatentSync is an audio-driven video generator and latent diffusion lip sync model designed to synchronize a speaker's lip movements in a video to a target audio track. It provides a lip synchronization training framework for developing synchronization networks on custom video and audio datasets. The system utilizes a video preprocessing pipeline to clean, segment, and align face data. It includes a visual sync evaluation tool that calculates confidence scores to measure the accuracy of audio and visual alignment in generated videos. The project covers capabilities for custom synchronization
Die Hauptfunktionen von alibaba-quark/liveavatar sind: Audio Driven Synthesis.
Open-Source-Alternativen zu alibaba-quark/liveavatar sind unter anderem: meigen-ai/infinitetalk — InfiniteTalk is an open-source system for generating talking head videos driven by audio input. It synthesizes… deepbrainai-research/discohead — Project Page | KoEBA Dataset. farzanehjafari1987/sedtalker — Farzaneh Jafari, Stefano Berretti, Anup Basu. fudan-generative-vision/hallo — Hallo is an audio-driven talking head generator and portrait animation framework. It synchronizes a static portrait… fudan-generative-vision/hallo2 — Hallo2 is an AI video generation tool and audio-driven portrait animation framework designed to transform static… bytedance/latentsync — LatentSync is an audio-driven video generator and latent diffusion lip sync model designed to synchronize a speaker's…
