awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索，发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
ggml-org avatar

ggml-org/whisper.cpp

0
View on GitHub↗
50,770 星标·5,668 分支·C++·MIT·15 次浏览

Whisper.cpp

Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud APIs or internet connectivity.

The project distinguishes itself through a hardware-agnostic compute abstraction that offloads intensive tensor operations to a wide array of accelerators, including specialized neural engines and graphics processors. It provides granular control over the transcription process, offering features such as word-level timestamps, speaker diarization, and voice activity detection. Developers can leverage these capabilities to build interactive voice-enabled applications, including chatbots with conversation session management and synchronized media generation.

Beyond its core transcription engine, the project supports a broad range of deployment environments, including web browsers via WebAssembly, mobile devices, and containerized server infrastructure. It includes tools for benchmarking performance across different hardware configurations and provides native language bindings to simplify integration into existing software stacks.

Features

  • Inference Engines - A lightweight runtime optimized for executing large-scale machine learning models on consumer hardware with minimal memory and compute overhead.
  • Local Inference Engines - Running high-performance speech-to-text models locally on consumer hardware without relying on external cloud APIs or internet connectivity.
  • Model Quantization - Converts high-precision model weights into lower-precision formats to reduce memory usage and improve inference speed.
  • Speaker Diarization - Identifies and labels distinct speakers within audio recordings to organize transcripts by individual participants.

AI 搜索

探索更多 awesome 仓库

用简单的语言描述您的需求 —— AI 将根据相关性为您从数千个精选开源项目中进行排序。

Start searching with AI
  • Speech Recognition - The project processes live audio input from microphones or streams to perform immediate speech-to-text conversion using selected models for instant results.
  • Speech Transcription - The project executes speech-to-text inference by loading models and processing local audio files to generate accurate text transcripts from recorded media.
  • Music Utilities - Generates synchronized video files with text overlays that highlight words as they are spoken for karaoke-style content representation.
  • Hardware Acceleration Abstractions - Provides a unified interface for offloading tensor operations to diverse accelerators including specialized neural engines and graphics processors.
  • Speech Recognition Services - Deploying scalable speech recognition services that process audio files and live streams via network requests for enterprise-grade applications.
  • Speech Processing Libraries - A portable library that converts spoken audio into text across diverse operating systems, hardware architectures, and embedded environments.
  • Conversation Management Systems - Maintains persistent context and state across multi-turn voice interactions to ensure coherent and interactive conversational sessions.
  • Hardware Acceleration - The project offloads heavy tensor computations to graphics hardware using parallel processing libraries to significantly increase speed for large-scale audio transcription tasks.
  • Hardware Acceleration Backends - The project executes model computations on specific graphics hardware by leveraging vendor-provided acceleration support to improve overall inference throughput.
  • Inference Accelerators - Optimizing machine learning model execution by offloading heavy mathematical computations to specialized graphics cards and neural processing units.
  • Inference Benchmarking Tools - Measures processing speed and latency across hardware configurations to determine performance for speech recognition tasks.
  • Speech-to-Text Engines - Enables local speech-to-text transcription directly within the browser using compiled modules.
  • Voice-Enabled Agents - The project provides the necessary dependencies and linking capabilities to create functional voice-enabled chatbot applications that combine speech-to-text and language models.
  • Process and Memory Management - Minimizes runtime overhead and prevents fragmentation by pre-allocating fixed memory buffers for model weights and intermediate computation states.
  • Linear Algebra - Improves matrix multiplication performance by linking against optimized linear algebra libraries for faster model execution on standard processors.
  • Web APIs - The project provides standard HTTP request support for sending audio data to a server and receiving JSON-formatted transcriptions and timing information.
  • AI & Machine Learning - Port of OpenAI's Whisper model in C/C++
  • Audio Generation and Processing - High-performance C/C++ port of the speech recognition model.
  • Model Serving and Inference - High-performance C/C++ port of the Whisper speech model.
  • Speech Recognition - High-performance C/C++ port of the speech recognition model.
  • Privacy-Preserving Runtimes - A privacy-focused execution environment that performs speech recognition entirely on the host device without requiring external network connectivity or cloud services.
  • Hardware Acceleration Kernels - A collection of optimized kernels that offload intensive tensor operations to specialized graphics and neural processing units for maximum throughput.
  • Voice Interaction Frameworks - Integrating real-time transcription and voice interaction capabilities into software applications to create responsive and accessible user experiences.
  • Speech Synthesis & TTS - The project supports the conversion of generated text responses into audible speech using integrated engines to provide a seamless voice-to-voice interaction experience.
  • Native Modules & Bridges - The project supports the integration of speech recognition models into mobile applications to enable real-time processing and file-based transcription on portable devices.
  • WebAssembly - The project allows speech recognition engines to be compiled into portable modules for high-performance audio processing within web browsers and other client-side environments.
  • Confidence Visualization Tools - Provides color-coded visual indicators for transcription accuracy to help users assess the reliability of processed text segments.
  • Machine Learning Toolkits - A flexible set of components for building voice-enabled applications, ranging from real-time streaming transcription to complex conversational chatbot interfaces.
  • Model Optimization - The project monitors and optimizes memory consumption by selecting appropriate model sizes and quantization levels to fit available hardware resources during inference.
  • Text Generation Controls - Provides configurable settings to adjust the maximum length and granularity of generated text segments for improved readability.
  • Build Systems - Utilizes modular build configurations to generate portable binaries for diverse environments ranging from mobile devices to web browsers.
  • Containerization Tools - The project supports executing speech recognition models inside isolated environments using pre-built images to ensure consistent performance and simplify the setup of complex software dependencies.
  • Deployment Services - The project enables the hosting of speech-to-text servers that accept audio files via network requests and return transcribed text using locally deployed models.

    • Star 历史

    ggml-org/whisper.cpp 的 Star 历史图表ggml-org/whisper.cpp 的 Star 历史图表

    常见问题解答

    ggml-org/whisper.cpp 是做什么的？

    Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud…

    ggml-org/whisper.cpp 的主要功能有哪些？

    ggml-org/whisper.cpp 的主要功能包括：Inference Engines, Local Inference Engines, Model Quantization, Speaker Diarization, Speech Recognition, Speech Transcription, Music Utilities, Hardware Acceleration Abstractions。

    ggml-org/whisper.cpp 有哪些开源替代品？

    ggml-org/whisper.cpp 的开源替代品包括： ggerganov/whisper.cpp — whisper.cpp is a C++ implementation of the Whisper speech-to-text model, serving as a lightweight machine learning… pipecat-ai/pipecat — Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech… alibaba/mnn — MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a… mozilla-ai/llamafile — Llamafile is a machine learning model runner and packager that enables local inference by bundling model weights and… blakeblackshear/frigate — Frigate is a self-hosted network video recorder that functions as a private, local AI-powered vision engine. It… microsoft/onnxruntime — This project is a cross-platform machine learning inference engine designed to execute pre-trained models across…

    Whisper.cpp 的开源替代方案

    相似的开源项目，按与 Whisper.cpp 的功能重合度排序。
    • ggerganov/whisper.cppggerganov 的头像

      ggerganov/whisper.cpp

      50,791在 GitHub 上查看↗

      whisper.cpp is a C++ implementation of the Whisper speech-to-text model, serving as a lightweight machine learning inference engine and quantized runtime. It provides high-performance automatic speech recognition and real-time audio transcription without requiring a Python environment. The project utilizes model quantization to reduce memory usage and increase inference speed on local hardware. It incorporates hardware acceleration to optimize processing speed across different processors. The system covers audio processing capabilities including voice activity detection, speaker diarization,

      C++
      在 GitHub 上查看↗50,791
    • pipecat-ai/pipecatpipecat-ai 的头像

      pipecat-ai/pipecat

      12,846在 GitHub 上查看↗

      Pipecat is a framework and software development kit for building real-time multimodal AI agents and speech-to-speech systems. It utilizes a frame-based data pipeline to route audio, video, and text through a modular sequence of processors, enabling the orchestration of low-latency conversational AI. The project is distinguished by its ability to coordinate complex multimodal services, including speech-to-text, language models, and text-to-speech, within a single pipeline. It features semantic voice activity detection for natural turn-taking, state-machine conversation flows for dialogue manag

      Pythonaichatbot-frameworkchatbots
      在 GitHub 上查看↗12,846
    • alibaba/mnnalibaba 的头像

      alibaba/MNN

      14,242在 GitHub 上查看↗

      MNN is a high-performance inference engine and framework designed for on-device machine learning. It provides a comprehensive environment for executing, optimizing, and deploying neural network models directly on mobile and resource-constrained edge devices. The framework distinguishes itself through a robust model optimization toolkit that supports quantization, compression, and structural graph manipulation to minimize memory footprint and maximize execution speed. It features a modular architecture that abstracts hardware-specific backends, allowing models to run efficiently across diverse

      C++armconvolutiondeep-learning
      在 GitHub 上查看↗14,242
    • mozilla-ai/llamafilemozilla-ai 的头像

      mozilla-ai/llamafile

      23,726在 GitHub 上查看↗

      Llamafile is a machine learning model runner and packager that enables local inference by bundling model weights and runtime environments into a single, self-contained executable. It functions as a cross-platform engine, allowing users to execute large language models and perform speech-to-text tasks directly on their own hardware without requiring external software dependencies or complex installations. The project distinguishes itself by utilizing a specialized binary format that allows the same executable to run natively across multiple operating systems and hardware architectures. It auto

      C
      在 GitHub 上查看↗23,726
    查看 Whisper.cpp 的所有 30 个替代方案→