Awesome GitHub RepositoriesReference-Driven Synthesis

MockingBird is an AI voice cloning tool and text-to-speech system designed to generate synthetic speech. It functions as a voice synthesis trainer for building custom models from audio datasets, a command-line generator for producing audio files, and a text-to-speech server for remote application integration. The project specializes in real-time voice cloning, which extracts vocal characteristics from short audio samples to mimic a target speaker's unique timbre. It utilizes reference-driven audio synthesis to condition pre-trained models on specific audio samples, allowing for the generation

AudioGPT is an LLM-driven audio framework and processing suite that uses large language models to orchestrate neural audio pipelines. It functions as a multimodal audio generator and processing system, integrating a collection of pretrained models to handle speech synthesis, sound generation, and audio manipulation. The system is distinguished by its ability to generate audio from diverse inputs, including text and images, and its capacity to produce synchronized talking head videos. It also operates as a neural speech translator, converting spoken language between different tongues while pre

ChatTTS-ui 是 ChatTTS 模型的 Web 界面和 API 封装，旨在将书面文本和混合语言输入转换为语音音频。它作为一个 AI 语音合成仪表板和用于创建自然语音输出的程序化生成器。 该项目专注于自定义语音配置和语音细微差别控制。它允许通过种子值和数据文件保持一致的说话人特征，同时通过行为提示和采样参数提供对语调、笑声和停顿的控制。 该系统包含一个处理异步音频处理的客户端-服务器架构，并为外部应用程序集成提供了程序化接口。它通过状态管理界面管理语音配置文件和音频配置，以确保合成的一致性。

ACE-Step is a high-fidelity audio synthesis system and diffusion model designed to generate music and vocals from text descriptions. It functions as a music generator and vocal synthesizer, using a diffusion transformer decoder to produce audio across various languages and genres. The project provides tools for text-guided audio editing, including the ability to extend the duration of tracks, regenerate specific song segments, and perform latent-space audio inpainting to modify lyrics or styles. It also includes a framework for audio style fine-tuning using low-rank adaptation to adapt vocal