For ai vocal pitch shift time stretch, the first results are svc-develop-team/so-vits-svc (This repository provides a singing voice conversion and pitch-guided synthesis tool built in Python, though it focuses more on voice identity transformation than general audio time stretching), rvc-project/retrieval-based-voice-conversion-webui (This project provides a powerful framework for AI-based voice conversion and synthesis with command-line and web interfaces, though it focuses primarily on timbre transformation rather than traditional pitch shifting and time stretching) and facebookresearch/demucs (Demucs provides AI-powered vocal isolation and music source separation using PyTorch, but it focuses strictly on splitting stems rather than handling pitch shifting or time stretching). anjok07/ultimatevocalremovergui and bytedance/music_source_separation round out the shortlist. Compare the match explanations and check the project documentation against your requirements.
The best open-source AI vocal pitch shifters and time stretchers. Compare top GitHub repositories and find the right one.
This project is a singing voice conversion tool based on VITS generative modeling. It transforms the identity of a singing voice to a target speaker while preserving the original melody, lyrics, and intonation. The system distinguishes itself through hybrid voice synthesis, allowing for the blending of multiple speaker identities via linear model interpolation. It utilizes cluster-based feature retrieval to increase target voice similarity and employs a diffusion probabilistic model as a post-processor to remove electronic artifacts and improve vocal clarity. The software covers a broad rang
This repository provides a singing voice conversion and pitch-guided synthesis tool built in Python, though it focuses more on voice identity transformation than general audio time stretching.
This project is a comprehensive software suite for voice synthesis and model management, providing a framework for training custom acoustic models and performing voice conversion. It utilizes deep-learning-based acoustic modeling to map source audio characteristics to target voice identities, enabling the transformation of input audio into specific vocal profiles. The system distinguishes itself through a feature-retrieval-based inference mechanism, which employs vector index files to perform nearest-neighbor searches on acoustic features for high-fidelity timbre matching. Users can manage th
This project provides a powerful framework for AI-based voice conversion and synthesis with command-line and web interfaces, though it focuses primarily on timbre transformation rather than traditional pitch shifting and time stretching.
Demucs is a deep learning stem splitter and AI music de-mixing software used to isolate vocals and instruments from a single audio file. It functions as a PyTorch audio source separation tool that splits mixed tracks into individual stems such as drums, bass, and vocals. The system is a hybrid spectrogram waveform separator that combines spectral and waveform analysis. This approach allows the software to process audio in both frequency and time domains to achieve high-fidelity source separation. The tool provides capabilities for audio source separation, including acapella track extraction
Demucs provides AI-powered vocal isolation and music source separation using PyTorch, but it focuses strictly on splitting stems rather than handling pitch shifting or time stretching.
Ultimate Vocal Remover is a desktop application designed for AI-driven audio source separation. It utilizes deep learning models to isolate vocals, drums, and other individual instruments from mixed audio files, providing a utility for professional production and creative editing workflows. The software distinguishes itself by leveraging GPU-accelerated tensor computation to perform complex signal processing tasks, significantly reducing the time required for high-fidelity audio extraction. It incorporates a modular plugin architecture that integrates external utilities to support a wide rang
Ultimate Vocal Remover is a desktop application focused primarily on AI-driven audio source separation rather than vocal pitch shifting and time stretching, making it a neighbouring audio-processing tool rather than the specific utility requested.
This project is a deep learning toolkit designed for audio source separation and music information retrieval. It provides a framework for decomposing polyphonic audio signals into distinct components, such as vocals, drums, and bass, by processing raw waveforms through neural network architectures. The library enables users to train custom separation models or fine-tune existing ones to improve accuracy on specific audio datasets. It supports the entire model lifecycle, including the conversion of raw audio into structured, indexed formats to optimize data loading and training efficiency. Th
This project is an audio source separation toolkit for isolating vocals rather than an AI-powered pitch shifter and time stretcher, making it a neighbouring building block rather than the complete tool requested.
Spleeter is an AI audio source separation library and deep learning toolkit designed to split mixed music files into individual audio stems, such as vocals and drums. It provides a suite of pretrained models for isolating different instruments and voices from a recording. The toolkit includes capabilities for training and evaluating custom audio separation models using labeled datasets and configuration files. It also features utilities for measuring model performance by comparing separation outputs against reference datasets. The system manages audio processing through spectral representati
This repository provides AI-powered audio source separation for isolating vocals from mixed music files, which is a building block for vocal processing but does not perform pitch shifting or time stretching.
mlx-audio is an audio processing toolkit built on Apple MLX that provides speech transcription, text-to-speech synthesis, voice cloning, and audio source separation using local models. It offers an OpenAI-compatible REST API and web interface for running audio generation and transcription tasks, enabling drop-in integration with existing tools that follow that endpoint structure. The toolkit supports text-prompted audio source separation, allowing specific sounds to be isolated from mixed recordings based on natural language descriptions. It also provides voice cloning from a short reference
This repository is an audio processing toolkit focused on transcription, text-to-speech, and source separation rather than a dedicated AI vocal pitch shifter and time stretcher.
Vocal-separate is an audio processing tool designed to isolate vocal and instrumental tracks from audio and video files. It functions as a local artificial intelligence engine that performs source separation directly on the user's machine, ensuring data privacy by eliminating the need for external server connectivity. The system provides a browser-based control interface for managing media uploads and monitoring processing tasks. To handle intensive signal decomposition, it utilizes hardware-accelerated tensor processing, which offloads complex mathematical calculations to dedicated graphics
Vocal-separate provides local AI vocal isolation and stem extraction, but it focuses purely on source separation rather than AI-powered vocal pitch shifting and time stretching.
ace-step-ui is an AI music production workspace and interface for generating, editing, and organizing synthetic audio tracks and vocals. It provides a technical control panel for managing prompts, seeds, and style parameters to produce high-quality audio. The project includes a digital audio workstation interface for trimming and fading files, alongside an audio stem separation tool that splits mixed tracks into individual components such as drums, bass, and vocals. It also features a music video creator for generating visual content and procedural album art to accompany generated music. The
This repository is a generative AI music production workspace and UI rather than a dedicated tool or library for vocal pitch shifting and time stretching.
ACE Step 1.5 is a local text-to-music generation and audio editing system that runs on consumer hardware. It transforms plain-language descriptions into full-length songs with lyrics, and can edit existing audio through cover generation, vocal removal, track separation, and selective repainting. The system supports multilingual prompts and lyrics in over 50 languages, and provides precise control over musical structure including duration, BPM, key, and time signature. The project distinguishes itself through a dual-stream diffusion architecture that processes separate latent streams for vocal
This repository is a text-to-music generation and audio editing system featuring source separation and vocal removal, but it lacks the specific AI-powered vocal pitch shifting and time stretching capabilities requested.
Whisper-diarization is a system for identifying and separating different speakers in audio recordings by combining OpenAI Whisper for transcription with automated speaker attribution. It functions as a pipeline that isolates vocal tracks from background noise and assigns transcribed segments to specific individuals. The project uses forced alignment to synchronize transcribed text timestamps with audio signals, improving the accuracy of speaker attribution. It employs voice activity detection to separate speech from silence and noise, ensuring precise boundaries for identification. The syste
This repository is a speaker diarization and transcription pipeline rather than a pitch shifter and time stretcher, making it a neighbouring audio tool rather than the requested AI vocal processing software.
Sonic Pi is a live coding music environment and algorithmic composition tool. It functions as a Ruby-based audio engine that allows users to compose and perform music in real time by writing and executing code during playback. The platform serves as an educational coding platform, using sound creation as a play-based environment to teach software logic and programming principles. It also acts as a MIDI and OSC controller for synchronizing external hardware and software. The system covers a broad range of audio capabilities, including software-based sound synthesis, audio sample manipulation,
Sonic Pi is a live coding music environment and algorithmic composition tool for programmatic music creation, which is a different category than an AI-powered vocal pitch shifter and time stretcher.
| Repository | Stars | Language | License | Last push |
|---|---|---|---|---|
| svc-develop-team/so-vits-svc | 28.1K | Python | AGPL-3.0 | |
| rvc-project/retrieval-based-voice-conversion-webui | 36K | Python | MIT | |
| facebookresearch/demucs |
| 10.2K |
| Python |
| MIT |
| anjok07/ultimatevocalremovergui | 23.7K | Python | mit |
| bytedance/music_source_separation | 1.4K | Python | NOASSERTION |
| deezer/spleeter | 28.3K | Python | MIT |
| blaizzy/mlx-audio | 6K | Python | mit |
| jianchang512/vocal-separate | 2K | Python | GPL-3.0 |
| fspecii/ace-step-ui | 4.1K | JavaScript | — |
| ace-step/ace-step-1.5 | 6K | Python | mit |