5 repository-uri
Tools for streaming data directly between different formats without loading entire datasets into memory.
Distinct from Data Format Interoperability: None of the candidates capture the streaming-based transcoding capability.
Explore 5 awesome GitHub repositories matching data & databases · Data Transcoders. Refine with filters or upvote what's useful.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Streams data directly between different formats without loading entire datasets into memory.
Draco is a library and toolset for compressing, transcoding, and decoding 3D geometric meshes and point cloud data. Its primary purpose is to reduce storage size and transmission bandwidth for 3D assets. The project includes a geometry optimizer specifically for glTF file containers to reduce asset footprints. It also features a hardened decoder designed to process malformed or untrusted 3D geometric data safely to prevent memory corruption and crashes. The software covers a broad range of 3D data processing capabilities, including geometric data reconstruction, point attribute management, a
Converts 3D meshes and point clouds between different compressed and standard geometric formats.
Markdig este un procesor Markdown de înaltă performanță pentru aplicații .NET care convertește textul Markdown în HTML sau alte formate țintă. Este un parser conform CommonMark și un motor extensibil care poate transforma Markdown într-un arbore sintactic abstract (AST) care poate fi căutat și manipulat. Biblioteca oferă un framework pentru adăugarea de sintaxă personalizată și logică de randare printr-un pipeline modular de parsere și randere. Suportă compilarea nativă ahead-of-time și trimming pentru a minimiza dimensiunea binarului. Capabilitățile includ generarea de HTML structurat cu atribute și stiluri personalizate, extragerea YAML front matter pentru procesarea site-urilor statice și conversia conținutului în text simplu. Motorul acoperă, de asemenea, îmbunătățiri tipografice, pregătirea formulelor matematice și formatarea automată a link-urilor. Procesorul include maparea precisă a sursei pentru a urmări intervalele de caractere și utilizează streaming-ul de output și limitele de adâncime de imbricare pentru a gestiona performanța și stabilitatea.
Preserves non-semantic whitespace and trivia to enable lossless roundtrip editing.
Superjson is a lossless JSON serialization library and data transcoder. It converts complex JavaScript and TypeScript data types into strings and metadata to ensure that type identity is preserved during data transfer. The library preserves non-native types such as Dates, Maps, and Sets by splitting values into a JSON-compatible payload and a separate map of type-specific metadata. It utilizes a registry-based mapping system that allows for the definition of custom type handlers to manage third-party data types during serialization and deserialization. This utility supports cross-process dat
Implements a lossless transcoding mechanism to preserve non-native types like Dates, Maps, and Sets during transport.
Markdig is a markdown parser library that converts text into structured HTML, plain text, or other formats using a configurable pipeline. It functions as a CommonMark compliant parser and an abstract syntax tree generator that transforms markdown into a hierarchical tree of block and inline nodes with precise source location mapping. The project is distinguished by a decoupled renderer architecture that separates parsing logic from output generation, enabling the transformation of the syntax tree into non-HTML formats such as LaTeX or XAML. It also serves as a lossless markdown processor by t
Ensures lossless processing by tracking whitespace and trivia, allowing the source to be re-rendered exactly.