smacke/ffsubsync
Ffsubsync
ffsubsync is a subtitle synchronization tool that aligns subtitle timestamps to audio tracks or reference files using voice activity detection and FFmpeg. It functions as an audio-based subtitle aligner that analyzes speech patterns within a video audio stream to correct timing.
The system provides capabilities for cross-language subtitle synchronization, allowing an unsynchronized file to be aligned using a correctly timed subtitle file in a different language as a reference. It also includes a remote media timing engine that streams audio references from network URLs to perform synchronization without downloading full media files.
The tool covers a broad range of media processing tasks, including audio track synchronization via voice activity detection and reference-based timing alignment using cross-correlation signal matching.
Features
- Subtitle Synchronization - Corrects the timing of subtitle files to match spoken audio using automated voice detection.
- Voice Activity Detection - Uses voice activity detection to identify speech boundaries and create timing maps for subtitle alignment.
- Subtitle Reference Alignment - Adjusts subtitle timestamps by calculating the linear offset between a target file and a synchronized reference.
- Audio-Text Cross-Correlation - Implements signal-processing cross-correlation to align subtitle timestamps with audio voice activity peaks.
- FFmpeg Subtitle Synchronizers - Aligns subtitle timing to audio tracks or reference files using voice activity detection and FFmpeg.
- Cross-Language Synchronization - Aligns unsynchronized subtitle files using a correctly timed version in a different language as a reference.
- Video Accessibility Tools - Improves video accessibility by ensuring subtitles are perfectly synchronized with the audio track.
- Remote Audio Sampling - Extracts audio data from network URLs using external tools to avoid downloading full media files.
- Remote Media Timing References - Provides the ability to stream timing references from network URLs to synchronize subtitles without downloading entire media files.
- Subtitles and Captions - Tool for automatically synchronizing subtitles with audio via machine learning.
