1 repo
Tools and platforms for hosting and serving software applications and models in production environments.
Distinguishing note: Focuses on the infrastructure and hosting aspect of deploying speech-to-text services rather than the model logic itself.
Explore 1 awesome GitHub repository matching devops & infrastructure · Deployment Services. Refine with filters or upvote what's useful.
Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud APIs or internet connectivity. The project distinguishes itself through a hardware-agnostic compute abstraction that offloa
The project enables the hosting of speech-to-text servers that accept audio files via network requests and return transcribed text using locally deployed models.