4 repositorios
Automated tools for importing various file formats into queryable tables.
Distinguishing note: Focuses on file-to-table conversion rather than general data loading.
Explore 4 awesome GitHub repositories matching data & databases · Structured Data Parsers. Refine with filters or upvote what's useful.
Nushell is a cross-platform shell and programming language designed to treat all input and output as structured data rather than raw text streams. By enforcing data types and command signatures, it provides a consistent environment for building robust, pipeline-oriented workflows. The shell allows users to chain commands that pass structured objects between stages, enabling complex data processing and automation tasks that remain predictable across different operating systems. What distinguishes the project is its focus on interactive data exploration and modular extensibility. Users can quer
Enables importing structured data from various formats by automatically detecting file types.
Toon is a data serialization library and toolkit designed to convert complex objects into compact, human-readable formats optimized for large language models. By focusing on token efficiency, the library minimizes the context window footprint of structured data through techniques like key folding and tabular layout optimization. It provides a streaming-capable processor that handles the encoding and decoding of hierarchical data while maintaining structural integrity. The project distinguishes itself through its path-aware transformation pipeline and configurable serialization logic, which al
Ships a streaming-capable processor that handles encoding and decoding of hierarchical data structures.
VisiData is a terminal-based interactive data analysis tool and browser designed for exploring, filtering, and sorting large tabular datasets. It functions as a structured data inspector that loads and flattens complex formats like JSON, XML, and PCAP into interactive sheets, as well as a terminal file manager for navigating directories and performing staged filesystem operations. The project distinguishes itself by rendering data visualizations, such as scatter plots and histograms, directly in the terminal using Unicode Braille characters. It provides a Python-based data wrangling environme
Imports hierarchical data from JSON, XML, and HTML by expanding nested lists into tabular columns.
Wuffs es un conjunto de herramientas para generar analizadores y decodificadores de memoria segura y aislados (sandboxed) a partir de especificaciones de lenguaje de dominio específico. Funciona como un compilador que transforma estas especificaciones en código ejecutable para C, Go o Rust, diseñado específicamente para decodificar formatos de archivo no confiables mientras se previenen desbordamientos de búfer y enteros. El proyecto emplea un modelo de ejecución aislado que prohíbe las llamadas al sistema y la gestión manual de la memoria para garantizar que los cálculos estén libres de efectos secundarios. Utiliza un sistema de tipos refinado y verificación de restricciones en tiempo de compilación para hacer cumplir la seguridad de la memoria, junto con aritmética saturada para evitar desbordamientos numéricos. El sistema proporciona implementaciones seguras para procesar datos estructurados, formatos de imagen y flujos comprimidos. Sus capacidades cubren la decodificación y codificación de imágenes, la descompresión de varios formatos de archivo y el cálculo de sumas de comprobación de integridad de datos. La integración se simplifica mediante la generación de bibliotecas C autónomas de un solo archivo y soporte de bibliotecas de solo cabecera.
A capability to process serialized formats like JSON and CBOR to extract organized information from raw byte streams.