5 dépôts
Tools for streaming data directly between different formats without loading entire datasets into memory.
Distinct from Data Format Interoperability: None of the candidates capture the streaming-based transcoding capability.
Explore 5 awesome GitHub repositories matching data & databases · Data Transcoders. Refine with filters or upvote what's useful.
This project is a framework for the efficient serialization and deserialization of data structures. It provides a unified, macro-based interface that automates the conversion of complex internal objects into standardized formats and reconstructs them from raw input streams or buffers. By leveraging compile-time code generation, the library minimizes manual implementation overhead while ensuring consistent logic across diverse data types. The framework distinguishes itself through a format-agnostic data model and a visitor-based parsing architecture that decouples data structures from specific
Streams data directly between different formats without loading entire datasets into memory.
Draco is a library and toolset for compressing, transcoding, and decoding 3D geometric meshes and point cloud data. Its primary purpose is to reduce storage size and transmission bandwidth for 3D assets. The project includes a geometry optimizer specifically for glTF file containers to reduce asset footprints. It also features a hardened decoder designed to process malformed or untrusted 3D geometric data safely to prevent memory corruption and crashes. The software covers a broad range of 3D data processing capabilities, including geometric data reconstruction, point attribute management, a
Converts 3D meshes and point clouds between different compressed and standard geometric formats.
Markdig est un processeur Markdown haute performance pour les applications .NET qui convertit le texte Markdown en HTML ou d'autres formats cibles. C'est un analyseur conforme à CommonMark et un moteur extensible capable de transformer Markdown en un arbre de syntaxe abstraite manipulable et interrogeable. La bibliothèque fournit un framework pour ajouter une logique de syntaxe et de rendu personnalisée via un pipeline modulaire d'analyseurs et de moteurs de rendu. Elle prend en charge la compilation native ahead-of-time et le trimming pour minimiser la taille des binaires. Les capacités incluent la génération de HTML structuré avec des attributs et styles personnalisés, l'extraction de YAML front matter pour le traitement de sites statiques, et la conversion de contenu en texte brut. Le moteur couvre également les améliorations typographiques, la préparation de formules mathématiques et le formatage automatique des liens. Le processeur inclut un mappage source précis pour suivre les étendues de caractères et utilise le streaming de sortie ainsi que des limites de profondeur d'imbrication pour gérer les performances et la stabilité.
Preserves non-semantic whitespace and trivia to enable lossless roundtrip editing.
Superjson is a lossless JSON serialization library and data transcoder. It converts complex JavaScript and TypeScript data types into strings and metadata to ensure that type identity is preserved during data transfer. The library preserves non-native types such as Dates, Maps, and Sets by splitting values into a JSON-compatible payload and a separate map of type-specific metadata. It utilizes a registry-based mapping system that allows for the definition of custom type handlers to manage third-party data types during serialization and deserialization. This utility supports cross-process dat
Implements a lossless transcoding mechanism to preserve non-native types like Dates, Maps, and Sets during transport.
Markdig is a markdown parser library that converts text into structured HTML, plain text, or other formats using a configurable pipeline. It functions as a CommonMark compliant parser and an abstract syntax tree generator that transforms markdown into a hierarchical tree of block and inline nodes with precise source location mapping. The project is distinguished by a decoupled renderer architecture that separates parsing logic from output generation, enabling the transformation of the syntax tree into non-HTML formats such as LaTeX or XAML. It also serves as a lossless markdown processor by t
Ensures lossless processing by tracking whitespace and trivia, allowing the source to be re-rendered exactly.