2 Repos
Techniques for improving the performance and efficiency of machine learning models specialized for audio.
Distinct from Audio Models: Candidates focus on model types (generation, source separation) rather than the optimization process (quantization, precision reduction).
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Audio Model Optimization. Refine with filters or upvote what's useful.
faster-whisper is an automatic speech recognition framework and an optimized implementation of the Whisper speech-to-text engine. It functions as a CTranslate2 inference engine designed to convert spoken audio into written text. The project serves as a model quantization tool that transforms large audio model weights into lower precision formats. This process reduces memory usage and increases execution speed on hardware by utilizing integer quantized weights. The framework covers a broad range of capabilities including batch audio transcription for parallel processing and voice activity det
Optimizes audio models via lower precision formats to improve hardware execution speed and memory requirements.
WhisperLiveKit is a real-time speech-to-text server that transcribes streaming audio into text with ultra-low latency using Whisper models. It serves transcription capabilities through REST endpoints and WebSocket connections, enabling external applications to send audio and receive transcriptions as words are spoken, making it suitable for live captioning or voice interfaces. The project distinguishes itself by combining real-time transcription with speaker diarization, assigning transcribed words to individual speakers during live audio streams for meeting or interview transcripts. It also
Allows selecting a model variant optimized for English audio to improve accuracy and speed.