canopyai/Orpheus-TTS
Orpheus TTS
Orpheus-TTS is an open-source text-to-speech system that generates human-like audio with controllable emotional tone and the ability to clone voices from short audio samples. It is built on an architecture that treats speech generation as a language modeling task, using a large language model trained on text-speech pairs to produce audio tokens autoregressively.
The system distinguishes itself through several key capabilities. It supports emotion-controllable speech synthesis by embedding emotional and intonation markers directly into text prompts, allowing the model to condition its output on expressive cues. It also offers low-latency streaming, outputting audio tokens incrementally as they are generated for real-time playback with approximately 200ms latency. Additionally, the model can be fine-tuned to custom voices using standard language model training pipelines and small paired datasets, and it supports zero-shot voice cloning that replicates a speaker's voice from reference audio without requiring any training.
The project covers emotional speech generation, multi-voice persona selection for varying conversational realism, and natural speech synthesis with realistic intonation and rhythm. It also provides voice cloning and customization capabilities, including emotional tone control and voice model fine-tuning.