hanmin0822/MisakaTranslator
MisakaTranslator
MisakaTranslator is a real-time game translation tool designed to extract text from games and manga and provide machine translations via external engines. It functions as a text extractor using both memory hooking to retrieve raw text directly from running processes and optical character recognition to convert images of in-game text into editable strings.
The tool includes a speech synthesizer to read translated dialogue and sentences aloud. To maintain accuracy, it utilizes a custom translation dictionary to manage specialized word lists and manual phrase mappings for character names and locations.
Features
- Real-Time Game Translators - Provides real-time translation of game dialogue using a combination of memory hooking and OCR.
- Optical Character Recognition - Uses optical character recognition to convert images of in-game text into editable strings.
- Screen Text Extractors - Performs OCR on screen regions to capture non-selectable in-game text for translation.
- OCR-Based Extraction - Converts visual in-game text into digital strings using image pre-processing and character recognition.
- Text Extraction - Retrieves text from visual media using either memory hooking or OCR to prepare it for translation.
- Game Memory Extraction - Extracts text directly from game engines by reading raw memory addresses without altering the game state.
- Text Memory Hooking - Directly reads text from running processes by monitoring specific memory addresses to bypass the need for OCR.
- Memory-Based Text Extractors - Identifies and extracts raw text directly from game memory addresses in real time.
- Speech and Text Translation APIs - Integrates with external translation APIs to convert extracted game text into the target language.
- Comic Text Extraction - Performs OCR specifically on game and manga images to extract text for real-time translation.
- Real-time Translation - Implements a real-time translation pipeline that sends extracted game text to external engines via network requests.
- Text-to-Speech Integrations - Integrates text-to-speech capabilities to read translated game dialogue as audible speech.
- Manual Translation Mappings - Allows users to define and export custom translations for specific phrases to ensure consistency.
- Dictionary Constraints - Manages custom dictionaries and constraints to prioritize specific names and locations during translation.
- Translation Term Segmenters - Uses custom dictionaries and segmentation rules to protect names and locations from incorrect machine translation.
- Speech Synthesis & TTS - Synthesizes translated dialogue into audible speech using a text-to-speech engine for playback.
- Text-to-Speech Synthesizers - Reads translated sentences aloud using text-to-speech technology to provide audio output.
- Memory Address Identification - Provides the capability to locate specific memory addresses in a running process to enable text extraction.
- Translation Term Mapping - Uses specialized translation term mapping to ensure consistent naming of characters and locations.
