# jamiepine/voicebox

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/jamiepine-voicebox).**

_How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._

30,041 stars · 3,714 forks · TypeScript · MIT

## Links

- GitHub: https://github.com/jamiepine/voicebox
- Homepage: https://voicebox.sh
- awesome-repositories: https://awesome-repositories.com/repository/jamiepine-voicebox.md

## Topics

`ai` `cuda` `mlx` `qwen3-tts` `qwen3-tts-ui` `voice-ai` `voice-clone` `whisper`

## Description

Voicebox is a local speech processing system that provides text-to-speech generation, speech-to-text transcription, and voice cloning. It utilizes local machine learning inference and GPU acceleration to process audio and text data without relying on external API calls.

The project features a voice cloning toolkit for creating synthetic profiles from audio samples and a timeline-based voice editor for composing multi-character conversations. It also includes an AI voice management API that allows external applications and AI agents to programmatically manage voice profiles and generate speech.

Capabilities cover audio processing pipelines for effects like pitch shifts and reverb, as well as real-time and file-based transcription with filler word removal. The system supports persona-based dialogue generation, batch synthesis with prompt caching, and global text dictation for inserting transcripts directly into the operating system clipboard.

The processing engine can be hosted on local hardware or remote GPU servers.

## Tags

### Artificial Intelligence & ML

- [Local Inference Engines](https://awesome-repositories.com/f/artificial-intelligence-ml/local-inference-engines.md) — Executes machine learning models on local GPU hardware to ensure low-latency speech generation and privacy.
- [Text-to-Speech](https://awesome-repositories.com/f/artificial-intelligence-ml/text-to-speech.md) — Converts text into natural sounding audio using local GPU acceleration to avoid cloud latency and fees.
- [Voice Profiling](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/conversational-voice-interaction/voice-agents/voice-profiling.md) — Enables the connection of AI agents to a local speech interface using specific voice profiles. ([source](https://voicebox.sh))
- [Audio Transcription](https://awesome-repositories.com/f/artificial-intelligence-ml/audio-transcription.md) — Converts speech from audio files to text using local models with adjustable accuracy settings. ([source](https://voicebox.sh))
- [Real-Time Transcription](https://awesome-repositories.com/f/artificial-intelligence-ml/audio-transcription/real-time-transcription.md) — Converts live microphone or system audio into text transcripts with real-time visualization. ([source](https://cdn.jsdelivr.net/gh/jamiepine/voicebox@main/README.md))
- [Local Speech-to-Text](https://awesome-repositories.com/f/artificial-intelligence-ml/local-speech-to-text.md) — Runs speech-to-text models on the host machine to convert audio streams into text offline.
- [Local AI Inference](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-deployment-and-serving/local-and-on-device-inference/local-ai-inference.md) — Executes machine learning models on personal GPU hardware to process audio and text without external API calls.
- [Synthetic Speech Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/multimodal-processing-tools/synthetic-speech-generation.md) — Converts text to audio using cloned voices with support for high-volume batch processing. ([source](https://cdn.jsdelivr.net/gh/jamiepine/voicebox@main/README.md))
- [Local Speech Synthesis](https://awesome-repositories.com/f/artificial-intelligence-ml/text-to-speech/local-speech-synthesis.md) — Converts text into audio using local engines with granular controls for emotion and long-form content. ([source](https://voicebox.sh))
- [Voice Cloning](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-cloning.md) — Creates synthetic voice profiles that replicate specific human vocal characteristics from short audio samples. ([source](https://cdn.jsdelivr.net/gh/jamiepine/voicebox@main/README.md))
- [Voice Cloning Toolkits](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-cloning-toolkits.md) — Ships a comprehensive set of utilities for creating synthetic voice profiles from audio samples.
- [Voice-Enabled Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-enabled-agents.md) — Provides the ability to link AI agent profiles to specific cloned voice models for natural speech output. ([source](https://voicebox.sh/))
- [Voice Agents](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/conversational-voice-interaction/voice-agents.md) — Connects AI agents to local speech synthesis endpoints to provide them with distinct audible personas.
- [Persona Identity Definitions](https://awesome-repositories.com/f/artificial-intelligence-ml/character-recognition-models/persona-identity-definitions.md) — Assigns personality traits and descriptions to voice profiles to influence dialogue composition. ([source](https://voicebox.sh/))
- [Voice Profile Management](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-profile-management.md) — Organizes cloned voices with language tags and descriptions while supporting sample import and export. ([source](https://cdn.jsdelivr.net/gh/jamiepine/voicebox@main/README.md))
- [Programmatic APIs](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-profile-management/programmatic-apis.md) — Provides a network interface for programmatic voice profile management and speech generation for external applications.
- [Programmatic Interfaces](https://awesome-repositories.com/f/artificial-intelligence-ml/voice-profile-management/programmatic-interfaces.md) — Provides a REST API to programmatically manage voice profiles and generate speech without external fees. ([source](https://voicebox.sh/))

### Part of an Awesome List

- [Voice Dictation](https://awesome-repositories.com/f/awesome-lists/ai/voice-dictation.md) — Inserts spoken transcripts into focused text fields or the clipboard using a global system shortcut. ([source](https://voicebox.sh/))
- [Narrative Timeline Editors](https://awesome-repositories.com/f/awesome-lists/media/voice-processing/narrative-timeline-editors.md) — Arranges multiple voice tracks on a timeline to build conversations with inline trimming and splitting. ([source](https://cdn.jsdelivr.net/gh/jamiepine/voicebox@main/README.md))

### Graphics & Multimedia

- [Audio Narrative Compositors](https://awesome-repositories.com/f/graphics-multimedia/audio-narrative-compositors.md) — Builds complex conversations and audio stories using a timeline editor with multiple cloned character voices.
- [Audio Processing Pipelines](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/audio-processing-systems/audio-processing/speech-to-text-pipelines/audio-processing-pipelines.md) — Routes synthetic speech through a sequential processing chain of pitch shifts and reverb effects.
- [Multi-Track Audio Sequencers](https://awesome-repositories.com/f/graphics-multimedia/multi-track-audio-sequencers.md) — Organizes multiple voice tracks and clips on a temporal axis for mixing multi-character conversations.

### Software Engineering & Architecture

- [Persona-Driven Dialogue Rewriting](https://awesome-repositories.com/f/software-engineering-architecture/software-architecture/foundational-theory-and-guidance/software-architecture-principles/user-experience-design/vocal-persona-design/generative-persona-synthesis/persona-driven-dialogue-rewriting.md) — Rewrites existing text or composes new lines based on a personality description assigned to a voice. ([source](https://voicebox.sh))

### User Interface & Experience

- [Voice Arrangement Timelines](https://awesome-repositories.com/f/user-interface-experience/animation-and-motion-systems/timeline-sequence-management/animation-timelines/voice-arrangement-timelines.md) — Provides a workspace for composing and mixing conversations between synthetic characters with trimming and effects.

### Web Development

- [TTS API Endpoints](https://awesome-repositories.com/f/web-development/custom-api-endpoints/endpoint-specification/service-endpoints/tts-api-endpoints.md) — Exposes text-to-speech synthesis and voice profile management as network-accessible API endpoints.