# krillinai/krillinai

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/krillinai-krillinai).**

9,396 stars · 807 forks · Go · gpl-3.0

## Links

- GitHub: https://github.com/krillinai/KrillinAI
- Homepage: https://www.klic.studio/
- awesome-repositories: https://awesome-repositories.com/repository/krillinai-krillinai.md

## Topics

`dubbing` `localization` `tts` `video-transcription` `video-translation`

## Description

KrillinAI is an AI video localization pipeline and toolset designed to automate the process of transcribing, translating, and dubbing video content into multiple languages. It provides a command-line interface to chain these stages into a single production workflow, coordinating speech-to-text transcription, translation, and audio generation.

The system features a translation framework that uses large language models to maintain professional terminology and natural semantics rather than literal word replacement. It includes a dubbing tool that utilizes text-to-speech and voice cloning to generate target-language voiceovers that match original speaker characteristics.

The project covers a broad range of media adaptation capabilities, including localized video rendering with adaptive subtitle layouts for different aspect ratios and the generation of platform-specific cover images. It also implements a JSON-based contract that allows external AI agents to trigger and manage localization tasks through predefined skill sets.

## Tags

### Artificial Intelligence & ML

- [Video Localization Platforms](https://awesome-repositories.com/f/artificial-intelligence-ml/video-localization-platforms.md) — Provides an integrated system for transcribing, translating, and dubbing video content into multiple languages.
- [AI Video Dubbing Tools](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-video-generators/ai-video-dubbing-tools.md) — Produces target-language voiceovers from subtitles using text-to-speech and voice cloning. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
- [Chaining Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/foundation-models/chaining-pipelines.md) — Sequences transcription, translation, and rendering stages into a linear execution flow to automate localization.
- [Semantic Translation Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/llm-translation-integrations/semantic-translation-frameworks.md) — Implements a translation framework using LLMs to maintain professional terminology and natural semantics in video subtitles.
- [Video Translation Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/llm-translation-integrations/video-translation-pipelines.md) — Uses large language models within an automated pipeline to translate video subtitles while preserving professional terminology.
- [Speech to Text Transcription](https://awesome-repositories.com/f/artificial-intelligence-ml/speech-to-text-transcription.md) — Converts audio from local files or online links into text subtitles using speech recognition models. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
- [Multi-Stage Synthesis Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/text-to-audio-synthesis/multi-stage-synthesis-pipelines.md) — Combines text-to-speech and voice cloning in a multi-stage pipeline to produce speaker-matched dubbed audio.
- [AI Agent Integrations](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-agent-integrations.md) — Integrates external AI agents to manage localization tasks via a stable contract and predefined skill sets. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
- [Command Line Interfaces](https://awesome-repositories.com/f/artificial-intelligence-ml/video-localization-platforms/command-line-interfaces.md) — Ships a command-line interface to chain transcription, translation, and rendering stages into a single automated production pipeline.

### Content Management & Publishing

- [Terminology-Aware Translation](https://awesome-repositories.com/f/content-management-publishing/media-management/subtitle-management-systems/subtitle-synchronization/subtitle-processing/terminology-aware-translation.md) — Translates subtitles using LLMs to preserve natural semantics and professional terminology. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
- [Adaptive Layouts](https://awesome-repositories.com/f/content-management-publishing/media-management/subtitle-management-systems/timestamped-subtitle-generators/burned-in-subtitle-rendering/adaptive-layouts.md) — Implements adaptive subtitle layouts to ensure readability across landscape and portrait video formats.

### Development Tools & Productivity

- [Automation Pipelines](https://awesome-repositories.com/f/development-tools-productivity/automation-pipelines.md) — Chains transcription, translation, and rendering into an automated sequence via a CLI.

### Graphics & Multimedia

- [Localized Compositing](https://awesome-repositories.com/f/graphics-multimedia/graphics-engines-rendering/rendering/systems/3d-graphics-pipelines/scene-renderers/high-quality-scene-rendering/high-dynamic-range-rendering/video-renderers/localized-compositing.md) — Composes final video files with bilingual or dubbed audio and aspect-ratio optimized subtitle layouts. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
- [Multilingual Compositing](https://awesome-repositories.com/f/graphics-multimedia/graphics-engines-rendering/rendering/systems/3d-graphics-pipelines/scene-renderers/high-quality-scene-rendering/high-dynamic-range-rendering/video-renderers/multilingual-compositing.md) — Composes final video files with translated subtitles and dubbed audio optimized for various screen formats.

### Web Development

- [Automated Translation Workflows](https://awesome-repositories.com/f/web-development/internationalization-localization/translation-management-platforms/automated-translation-workflows.md) — Automates the end-to-end chaining of transcription, translation, and rendering via a command-line interface. ([source](https://cdn.jsdelivr.net/gh/krillinai/krillinai@master/README.md))
