Heartlib is an audio processing library for large language models that provides tools for audio tokenization, compression, and cross-modal alignment. It implements core models for audio-text embedding, automatic speech recognition, neural codecs, and text-driven audio synthesis. The project features a text-to-audio synthesis engine capable of generating high-fidelity music and speech from text descriptions or reference files. It also includes a neural audio codec designed for low-bitrate compression that preserves acoustic structure and sound quality. Additional capabilities cover audio-text
Librosa is a Python audio analysis library and digital signal processing framework. It functions as a feature extraction suite and music information retrieval tool designed to analyze the structural and sonic characteristics of audio signals. The library provides specialized capabilities for music analysis, including dynamic tempo tracking to identify rhythmic pulses and spectral feature extraction to compute harmonic spectra, chroma variants, and onset points. It also serves as a time-series audio processor for synchronizing audio streams. The system covers a broad range of audio processing
A cross-browser wrapper for the Web Audio API which aims to closely follow the standard.
A beat detection utility which is using the Web Audio API.
p5.sound brings the Processing approach to Web Audio and p5.js. Demos:
The main features of processing/p5.js-sound are: Audio Processing Libraries.
Open-source alternatives to processing/p5.js-sound include: heartmula/heartlib — Heartlib is an audio processing library for large language models that provides tools for audio tokenization,… librosa/librosa — Librosa is a Python audio analysis library and digital signal processing framework. It functions as a feature… chrisguttandin/standardized-audio-context — A cross-browser wrapper for the Web Audio API which aims to closely follow the standard. go-audio/audio — Generic Go package designed to define a common interface to analyze and/or process audio data. go-audio/wav — Battle tested Wav decoder/encoder. chrisguttandin/web-audio-beat-detector — A beat detection utility which is using the Web Audio API.