spotify/basic-pitch
Basic Pitch
Basic-pitch ist ein neuronaler Audio-Transkribierer und polyphoner Tonhöhendetektor. Er fungiert als Audio-zu-MIDI-Konverter, der polyphone Audioaufnahmen in MIDI-Notenereignisse und Pitch-Bend-Daten umwandelt.
Das System bewahrt den musikalischen Ausdruck, indem es kontinuierliche Frequenzschwankungen verfolgt, um Glides und Vibrato in MIDI-Pitch-Bend-Ereignisse umzuwandeln. Es nutzt eine pluggbare Inference-Engine, die es ermöglicht, die Modell-Laufzeit basierend auf dem Betriebssystem oder den Anforderungen an die Hardwarebeschleunigung zu konfigurieren.
Das Projekt bietet ein Command-Line-Interface für die Batch-Audioverarbeitung und eine programmatische Schnittstelle zur Integration von Transkription und Notenereignis-Extraktion in benutzerdefinierte Software. Transkriptionsergebnisse können als MIDI-Dateien, rohe Modellausgaben und Notenereignis-Tabellen exportiert werden.
Features
- Audio Transcription Models - Uses a deep learning model to detect multiple simultaneous musical pitches from raw audio waveforms.
- Automated Music Transcription - Uses neural networks to programmatically turn audio files into MIDI data and note events.
- Neural Audio Transcribers - Uses a machine learning system to detect musical pitches in audio files to automate the transcription process.
- AI Audio Analysis - Processes audio data using AI to extract multiple simultaneous musical notes for transcription.
- Audio-to-MIDI Converters - Transforms polyphonic audio recordings into MIDI note events and pitch bend data using neural networks.
- Audio-to-MIDI Pipelines - Implements a pipeline that sequentially processes raw audio through a neural network to produce MIDI files.
- Audio-to-MIDI Transcription - Converts polyphonic audio recordings into MIDI files to capture notes and pitch bends for music production.
- Pitch Bend Detection - Tracks continuous frequency fluctuations to convert glides and vibrato into MIDI pitch bend events.
- Polyphonic Audio-to-MIDI Transcription - Transforms polyphonic audio files into MIDI format with pitch bend detection to preserve musical expression.
- Polyphonic Pitch Detectors - Identifies multiple simultaneous notes and frequency changes within an audio signal.
- Polyphonic Pitch Tracking - Analyzes complex audio signals to separate and identify individual overlapping notes across a wide frequency range.
- CLI Transcription Tools - Provides a command-line tool for transcribing audio files directly into MIDI data from the terminal.
- Audio Command-Line Tools - Provides terminal-based utilities for processing audio files into MIDI transcriptions.
- Audio Transcription APIs - Provides a programmatic interface for integrating audio-to-MIDI transcription into custom software applications.
- CLI Data Processors - Provides a command-line tool that transforms audio files into structured MIDI notation data.
- Audio Processing Automation - Exposes the model runtime through a terminal interface for batch processing and automated file conversion.
