5 个仓库
Tools for streaming data directly between different formats without loading entire datasets into memory.
Distinct from Data Format Interoperability: None of the candidates capture the streaming-based transcoding capability.
Explore 5 awesome GitHub repositories matching data & databases · Data Transcoders. Refine with filters or upvote what's useful.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Streams data directly between different formats without loading entire datasets into memory.
Draco is a library and toolset for compressing, transcoding, and decoding 3D geometric meshes and point cloud data. Its primary purpose is to reduce storage size and transmission bandwidth for 3D assets. The project includes a geometry optimizer specifically for glTF file containers to reduce asset footprints. It also features a hardened decoder designed to process malformed or untrusted 3D geometric data safely to prevent memory corruption and crashes. The software covers a broad range of 3D data processing capabilities, including geometric data reconstruction, point attribute management, a
Converts 3D meshes and point clouds between different compressed and standard geometric formats.
Markdig 是一个用于 .NET 应用的高性能 Markdown 处理器,可将 Markdown 文本转换为 HTML 或其他目标格式。它是一个符合 CommonMark 标准的解析器和可扩展引擎,能够将 Markdown 转换为可搜索和可操作的抽象语法树。 该库提供了一个框架,通过解析器和渲染器的模块化流水线来添加自定义语法和渲染逻辑。它支持原生提前编译(AOT)和修剪(trimming),以最大限度地减小二进制体积。 功能包括生成带有自定义属性和样式的结构化 HTML、提取用于静态站点处理的 YAML 前置元数据(front matter),以及将内容转换为纯文本。该引擎还涵盖了排版增强、数学公式准备和自动化链接格式化。 该处理器包含精确的源映射以跟踪字符跨度,并采用输出流和嵌套深度限制来管理性能和稳定性。
Preserves non-semantic whitespace and trivia to enable lossless roundtrip editing.
Superjson is a lossless JSON serialization library and data transcoder. It converts complex JavaScript and TypeScript data types into strings and metadata to ensure that type identity is preserved during data transfer. The library preserves non-native types such as Dates, Maps, and Sets by splitting values into a JSON-compatible payload and a separate map of type-specific metadata. It utilizes a registry-based mapping system that allows for the definition of custom type handlers to manage third-party data types during serialization and deserialization. This utility supports cross-process dat
Implements a lossless transcoding mechanism to preserve non-native types like Dates, Maps, and Sets during transport.
Markdig is a markdown parser library that converts text into structured HTML, plain text, or other formats using a configurable pipeline. It functions as a CommonMark compliant parser and an abstract syntax tree generator that transforms markdown into a hierarchical tree of block and inline nodes with precise source location mapping. The project is distinguished by a decoupled renderer architecture that separates parsing logic from output generation, enabling the transformation of the syntax tree into non-HTML formats such as LaTeX or XAML. It also serves as a lossless markdown processor by t
Ensures lossless processing by tracking whitespace and trivia, allowing the source to be re-rendered exactly.