5 Repos
Tools for streaming data directly between different formats without loading entire datasets into memory.
Distinct from Data Format Interoperability: None of the candidates capture the streaming-based transcoding capability.
Explore 5 awesome GitHub repositories matching data & databases · Data Transcoders. Refine with filters or upvote what's useful.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Streams data directly between different formats without loading entire datasets into memory.
Draco is a library and toolset for compressing, transcoding, and decoding 3D geometric meshes and point cloud data. Its primary purpose is to reduce storage size and transmission bandwidth for 3D assets. The project includes a geometry optimizer specifically for glTF file containers to reduce asset footprints. It also features a hardened decoder designed to process malformed or untrusted 3D geometric data safely to prevent memory corruption and crashes. The software covers a broad range of 3D data processing capabilities, including geometric data reconstruction, point attribute management, a
Converts 3D meshes and point clouds between different compressed and standard geometric formats.
Markdig ist ein High-Performance-Markdown-Prozessor für .NET-Anwendungen, der Markdown-Text in HTML oder andere Zielformate konvertiert. Es ist ein CommonMark-konformer Parser und eine erweiterbare Engine, die Markdown in einen durchsuchbaren und manipulierbaren Abstract Syntax Tree (AST) umwandeln kann. Die Bibliothek bietet ein Framework, um durch eine modulare Pipeline aus Parsern und Renderern eigene Syntax und Rendering-Logik hinzuzufügen. Sie unterstützt natives Ahead-of-Time-Kompilieren und Trimming, um die Binärgröße zu minimieren. Zu den Funktionen gehören die Generierung von strukturiertem HTML mit benutzerdefinierten Attributen und Styling, das Extrahieren von YAML-Front-Matter für Static-Site-Processing sowie die Konvertierung von Inhalten in Plain Text. Die Engine deckt zudem typografische Verbesserungen, die Vorbereitung mathematischer Formeln und automatische Link-Formatierung ab. Der Prozessor beinhaltet präzises Source-Mapping zur Nachverfolgung von Character-Spans und nutzt Output-Streaming sowie Limits für die Verschachtelungstiefe, um Performance und Stabilität zu gewährleisten.
Preserves non-semantic whitespace and trivia to enable lossless roundtrip editing.
Superjson is a lossless JSON serialization library and data transcoder. It converts complex JavaScript and TypeScript data types into strings and metadata to ensure that type identity is preserved during data transfer. The library preserves non-native types such as Dates, Maps, and Sets by splitting values into a JSON-compatible payload and a separate map of type-specific metadata. It utilizes a registry-based mapping system that allows for the definition of custom type handlers to manage third-party data types during serialization and deserialization. This utility supports cross-process dat
Implements a lossless transcoding mechanism to preserve non-native types like Dates, Maps, and Sets during transport.
Markdig is a markdown parser library that converts text into structured HTML, plain text, or other formats using a configurable pipeline. It functions as a CommonMark compliant parser and an abstract syntax tree generator that transforms markdown into a hierarchical tree of block and inline nodes with precise source location mapping. The project is distinguished by a decoupled renderer architecture that separates parsing logic from output generation, enabling the transformation of the syntax tree into non-HTML formats such as LaTeX or XAML. It also serves as a lossless markdown processor by t
Ensures lossless processing by tracking whitespace and trivia, allowing the source to be re-rendered exactly.