5 个仓库
Tools for translating between hexadecimal codepoints and surrogate pairs for character data handling.
Distinct from Emoji Support: None of the candidates were relevant; this focuses on low-level codepoint translation.
Explore 5 awesome GitHub repositories matching data & databases · Codepoint Conversion Utilities. Refine with filters or upvote what's useful.
Twemoji is a library designed to provide consistent emoji rendering across different web browsers and operating systems. It functions by identifying and extracting Unicode emoji sequences from text and replacing them with standardized graphical assets, ensuring that symbols appear identical regardless of the underlying platform. The project distinguishes itself by offering a comprehensive toolkit that combines parsing logic with a library of scalable vector and rasterized image assets. This allows for the programmatic transformation of text into high-quality visual representations, supporting
Translates between hexadecimal codepoints and surrogate pairs for programmatic character data handling.
RapidJSON is a high-performance C++ library used for parsing and generating JSON data. It provides both document object model and stream-based interfaces to transform JSON strings into structured data and vice versa. The library includes a JSON schema validator to verify that documents conform to predefined rules and a Unicode transcoder for converting strings between UTF-8, UTF-16, and UTF-32 encodings. It also supports relaxed parsing for non-standard JSON containing comments or trailing commas. Additional capabilities cover JSON pointer navigation for locating specific values and string s
Provides a utility for converting JSON strings between UTF-8, UTF-16, and UTF-32 encodings.
Hammerspoon is a programmable automation engine for macOS that enables deep system-level control through a Lua scripting environment. By bridging high-level scripts with native Objective-C APIs, it allows users to interact with the operating system's accessibility tree, intercept hardware input streams, and manage the lifecycle of running applications. The project distinguishes itself through an event-driven architecture that registers asynchronous hooks for system notifications and hardware events. This allows for real-time automation, such as remapping keyboard and mouse inputs, managing wi
Transforms numeric Unicode codepoints into valid UTF-8 byte sequences.
python-ftfy 是一个 Unicode 文本修复库,旨在修复乱码和编码故障。它提供字节编码检测、HTML 实体解码以及恢复损坏文本以将其还原为预期 Unicode 形式的实用程序。 该项目通过一个多层解码流水线脱颖而出,该流水线可识别并还原复杂的编码混淆。它使用基于启发式的检测来解决在多层损坏中因使用错误编码解码文本的情况,并且可以处理非标准 UTF-8 变体和不规范的编码映射。 该库还涵盖了广泛的文本标准化任务,包括 Unicode 规范化、换行符标准化和拉丁连字扩展。它包括字符宽度规范化以及删除终端转义符和控制字符的功能。 提供了一个命令行界面,用于自动化检测和修复文件中的 Unicode 故障。
Maps unmapped bytes in single-byte encodings to ensure interoperability with web browsers and Windows.
这是一个 Unicode 文本修复工具和乱码(Mojibake)纠正库,旨在修复编码故障并从乱码字符串中恢复原始字符。它作为一个文本编码检测器和 Unicode 规范化工具,用于解决文本解码错误的问题。 该库专注于反转多层编码错误并修复复杂的乱码模式。它包括检测有损编码序列、猜测字节编码以及解码非标准 UTF-8 变体的功能。 该工具集涵盖了广泛的文本清理和规范化任务,包括解码 HTML 实体和反斜杠转义、扩展拉丁连字,以及标准化字符宽度和换行符。它还提供了用于删除不可见控制字符和按码点检查 Unicode 字符串的实用程序。 提供了一个命令行界面,用于修复文件或输入流中的 Unicode 故障和编码错误。
Replaces UTF-16 surrogate pairs with correct characters to fix text decoded via obsolete standards.