# ufal/whisper_streaming

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/ufal-whisper-streaming).**

_How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._

3,642 stars · 408 forks · Python · MIT

## Links

- GitHub: https://github.com/ufal/whisper_streaming
- awesome-repositories: https://awesome-repositories.com/repository/ufal-whisper-streaming.md

## Description

Whisper streaming is an automated speech recognition engine designed to convert live audio into text. It functions as a network-based transcription server that accepts raw audio data from remote clients and returns incremental text results in real-time.

The system distinguishes itself through its ability to process audio streams incrementally, allowing for immediate transcription and translation as speech is captured. It incorporates voice activity detection to isolate human speech from background noise and utilizes sliding-window buffering to manage incoming audio segments, ensuring that processing remains efficient and coherent over long durations.

Beyond live transcription, the project supports remote audio processing and provides tools to simulate real-time conditions using pre-recorded files. These capabilities allow for the benchmarking of speech recognition models and the testing of latency under controlled environments. The software is distributed as a Python-based package.

## Tags

### Artificial Intelligence & ML

- [Real-Time Audio Transcribers](https://awesome-repositories.com/f/artificial-intelligence-ml/real-time-audio-transcribers.md) — Processes incoming audio streams incrementally to generate text transcriptions immediately as speech is captured. ([source](https://github.com/ufal/whisper_streaming#readme))
- [Transcription APIs](https://awesome-repositories.com/f/artificial-intelligence-ml/audio-transcription/transcription-apis.md) — Provides a network interface for remote clients to send raw audio and receive live text results. ([source](https://github.com/ufal/whisper_streaming#readme))
- [Incremental Inference Streaming](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-inference-serving/model-integration-pipelines/model-inference/inference-result-processors/incremental-inference-streaming.md) — Feeds audio chunks into a pre-trained model to generate partial text results before the entire stream completes.
- [Speech Recognition Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/speech-processing/automatic-speech-recognition/speech-recognition-engines.md) — Identifies human voice segments and converts spoken language into written text with low-latency buffering.
- [Real-Time Speech Transcription](https://awesome-repositories.com/f/artificial-intelligence-ml/real-time-speech-processing/real-time-speech-transcription.md) — Converts live audio streams into text instantly as speech occurs to support automated note-taking workflows.
- [Real-Time Speech-to-Text Servers](https://awesome-repositories.com/f/artificial-intelligence-ml/real-time-speech-to-text-servers.md) — Provides a communication interface for transmitting raw audio data to remote servers to receive incremental text results.
- [Speech-to-Text Transcribers](https://awesome-repositories.com/f/artificial-intelligence-ml/speech-to-text-transcribers.md) — Processes audio files or streams to generate accurate text transcriptions or language translations. ([source](https://github.com/ufal/whisper_streaming/blob/main/README.md))
- [Voice Activity Detection](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/conversational-voice-interaction/voice-agents/voice-activity-detection.md) — Analyzes incoming audio streams to isolate human speech and prevent background noise from triggering unnecessary inference.

### Business & Productivity Software

- [Live Voice-to-Text Translation](https://awesome-repositories.com/f/business-productivity-software/translation-services/live-voice-to-text-translation.md) — Processes spoken language in real-time to generate immediate text translations for cross-lingual communication.

### Graphics & Multimedia

- [Audio Over IP](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/media-manipulation/media-processing/streaming-network-frameworks/audio-over-ip.md) — Transmits raw microphone data over a network to a central server for speech recognition tasks.

### Networking & Communication

- [Backend Audio Streaming](https://awesome-repositories.com/f/networking-communication/real-time-audio-capture-protocols/webrtc-audio-streaming/backend-audio-streaming.md) — Transmits raw audio data over network connections to enable remote microphone input for real-time processing. ([source](https://github.com/ufal/whisper_streaming/blob/main/README.md))
- [Audio Streaming Servers](https://awesome-repositories.com/f/networking-communication/socket-networking/audio-streaming-servers.md) — Transmits raw audio bytes over persistent network connections for real-time communication between clients and the server.

### Operating Systems & Systems Programming

- [Real-Time Audio Streaming Buffers](https://awesome-repositories.com/f/operating-systems-systems-programming/kernel-core-internals/process-and-memory-management/memory-management/buffer-and-cache-management/binary-buffer-managers/trace-buffer-managers/audio-buffers/real-time-audio-streaming-buffers.md) — Maintains a rolling memory buffer of incoming audio segments to allow incremental processing while discarding already transcribed data.