spotify/basic-pitch
Basic Pitch
Basic-pitch is a neural network audio transcriber and polyphonic pitch detector. It functions as an audio-to-MIDI converter that transforms polyphonic audio recordings into MIDI note events and pitch bend data.
The system preserves musical expression by tracking continuous frequency fluctuations to convert glides and vibrato into MIDI pitch bend events. It utilizes a pluggable inference engine that allows the model runtime to be configured based on the operating system or hardware acceleration needs.
The project provides a command line interface for batch audio processing and a programmatic interface for integrating transcription and note event extraction into custom software. Transcription results can be exported as MIDI files, raw model outputs, and note event spreadsheets.
Features
- Audio Transcription Models - Uses a deep learning model to detect multiple simultaneous musical pitches from raw audio waveforms.
- Automated Music Transcription - Uses neural networks to programmatically turn audio files into MIDI data and note events.
- Neural Audio Transcribers - Uses a machine learning system to detect musical pitches in audio files to automate the transcription process.
- AI Audio Analysis - Processes audio data using AI to extract multiple simultaneous musical notes for transcription.
- Audio-to-MIDI Converters - Transforms polyphonic audio recordings into MIDI note events and pitch bend data using neural networks.
- Audio-to-MIDI Pipelines - Implements a pipeline that sequentially processes raw audio through a neural network to produce MIDI files.
- Audio-to-MIDI Transcription - Converts polyphonic audio recordings into MIDI files to capture notes and pitch bends for music production.
- Pitch Bend Detection - Tracks continuous frequency fluctuations to convert glides and vibrato into MIDI pitch bend events.
- Polyphonic Audio-to-MIDI Transcription - Transforms polyphonic audio files into MIDI format with pitch bend detection to preserve musical expression.
- Polyphonic Pitch Detectors - Identifies multiple simultaneous notes and frequency changes within an audio signal.
- Polyphonic Pitch Tracking - Analyzes complex audio signals to separate and identify individual overlapping notes across a wide frequency range.
- CLI Transcription Tools - Provides a command-line tool for transcribing audio files directly into MIDI data from the terminal.
- Audio Command-Line Tools - Provides terminal-based utilities for processing audio files into MIDI transcriptions.
- Audio Transcription APIs - Provides a programmatic interface for integrating audio-to-MIDI transcription into custom software applications.
- CLI Data Processors - Provides a command-line tool that transforms audio files into structured MIDI notation data.
- Audio Processing Automation - Exposes the model runtime through a terminal interface for batch processing and automated file conversion.
