21 repositorios
Utilities for serializing and exporting scan results into structured data formats.
Distinguishing note: Focuses on the output capabilities of network scanning tools.
Explore 21 awesome GitHub repositories matching data & databases · Data Export Formats. Refine with filters or upvote what's useful.
Manim is a scriptable, code-driven framework designed for generating precise technical visualizations and mathematical animations. By using a high-level programming interface, it allows users to define geometric shapes, motion paths, and animation logic that are compiled into high-quality video assets. The system functions as a specialized engine for creating reproducible, data-driven representations of complex mathematical concepts and geometric transformations. The framework distinguishes itself through an interpolation-based engine that calculates intermediate states between keyframes to e
Manim produces output in standard formats to facilitate integration with external tools, data processing pipelines, or custom analysis software.
Langextract is a framework designed to transform unstructured text into structured, machine-readable data using language model orchestration. It provides a high-performance pipeline that processes large volumes of narrative text by utilizing parallel execution and sequential extraction passes. The library is built to handle complex data extraction tasks, including specialized support for clinical information and medical entity relationship recognition. The project distinguishes itself through a plugin-based architecture that supports both local hardware execution and cloud-hosted model endpoi
Saves and loads extracted data using the JSONL format for portability and easy integration.
Masscan is a command-line network scanner designed for large-scale discovery and infrastructure reconnaissance. It identifies open ports across specific network segments or the entire internet by probing vast address ranges with high efficiency. The tool functions as an asynchronous packet engine, bypassing standard operating system kernel networking stacks to transmit raw packets directly from application memory. The project distinguishes itself through a specialized architecture that manages millions of concurrent connections by separating packet transmission and reception into independent
Saves collected data into common formats like XML, JSON, or plain text for external processing.
cloc is a codebase metrics tool and multi-language code analyzer designed to count blank lines, comment lines, and physical lines of code. It serves as a source code line counter and report generator that identifies file types to calculate source volume across a wide variety of programming languages. The tool distinguishes itself by providing codebase version comparison to measure relative changes in source and comment lines between two versions of a directory or archive. It also supports the definition of custom languages and the extension of language recognition by loading custom comment fi
Serializes analysis results into structured data formats including JSON, XML, YAML, SQL, Markdown, and CSV.
This project is a Python-based framework that functions as a generative AI agent for programmatic data analysis. It enables users to interact with structured data sources through natural language prompts, translating these requests into executable code to perform analysis, data cleaning, and visualization. By maintaining conversational context across multi-turn interactions, the system allows for iterative exploration and the building of complex data narratives. The framework distinguishes itself through a robust semantic layer and secure execution model. It maps raw datasets to descriptive m
Exports generated visualizations to local storage in standard image formats.
bandwhich is a command-line network utility and terminal bandwidth monitor designed for real-time traffic analysis. It functions as a process-based traffic tracker that links network bandwidth usage directly to the system processes and remote hosts responsible for the data transfer. The tool provides a terminal user interface for monitoring active connections and identifying data-consuming applications. It performs background reverse DNS lookups to associate remote IP addresses with human-readable hostnames and tracks cumulative data utilization over the duration of a capture session. Its br
Serializes network statistics into delimited raw text formats for external analysis.
This project is a comprehensive geographic location dataset and reference library providing standardized data for countries, states, and cities. It serves as a source of truth for regional hierarchies, ISO codes, coordinates, and timezone information, available as both a relational SQL database and a document-based JSON library. The project includes a custom dataset export tool that functions as a filtering engine. This allows for the generation of tailored geographic files in JSON, CSV, and GeoJSON formats by selecting only the specific regions or fields required. The dataset covers global
Provides a filtering engine to generate tailored geographic files in JSON, CSV, or SQL.
Maltrail is a malicious traffic detection system used for network intrusion detection. It consists of a network intrusion sensor for monitoring interfaces, a threat intelligence aggregator for syncing blacklists, and a detection engine that identifies security threats through signature matching and heuristic attack patterns. The system distinguishes itself through a distributed sensor architecture that collects traffic data from multiple remote probes and forwards events to a central analysis server. It employs heuristic behavioral analysis to identify unknown threats, such as port scanning o
Sends detected threat logs to external monitoring systems using standardized formats like CEF or JSON via Syslog or Logstash.
LOLBAS is a curated database and knowledge base of signed Windows binaries that can be misused to bypass security restrictions and execute unauthorized code. It serves as a technical registry that maps trusted system files to their functional capabilities and the offensive tactics they enable. The project distinguishes itself by providing a capability-driven indexing system and a tactics registry that relates legitimate binary functionality to known security evasion techniques. It includes an association layer that links specific system binaries to attack patterns and tactical objectives, pro
Provides the ability to export the binary collection as JSON, CSV, or YAML files for external analysis.
Tabulator is an interactive data table library and virtual DOM data grid used to create high-performance tables from JSON or arrays. It functions as a hierarchical data viewer and a spreadsheet interface component, capable of rendering thousands of records efficiently through viewport-based virtualization and progressive loading. The library distinguishes itself by providing a full spreadsheet interface mode with multi-sheet management, cell range selection, and bulk copy-paste capabilities. It supports complex data architectures, including nested data field mapping, expandable tree structure
Transforms table data into specific file structures and MIME types using custom functions.
Trippy is a network diagnostic tool and terminal user interface that combines ping and traceroute functionality to analyze network paths and performance. It provides a network packet parser and path analyzer to detect packet loss, jitter, and multipath routing through continuous network probing. The project is distinguished by its support for specialized tracing strategies, including Paris and Dublin, to ensure consistent path discovery. It identifies network address translation devices and utilizes heuristic analysis to distinguish genuine packet loss from rate-limiting. Broad capability ar
Exports network scanning and tracing results into structured formats like JSON, CSV, and Graphviz DOT.
Make Zotero effective for us LaTeX holdouts
Produces highly tailored bibliographic exports with fixed date fields and automatic journal abbreviations.
mmocr es un framework de reconocimiento óptico de caracteres basado en PyTorch diseñado para entrenar y desplegar modelos de detección de texto, reconocimiento y extracción de información clave. Sirve como una caja de herramientas integral para la detección y reconocimiento de texto en escenas, proporcionando bibliotecas especializadas para localizar regiones de texto y convertir texto visual en cadenas codificadas por máquina. El proyecto se distingue por un framework de investigación para la extracción de información clave y capacidades avanzadas de detección de texto. Estas incluyen la detección basada en puntos utilizando transformers y el uso de curvas de Bezier parametrizadas para identificar y transcribir texto con formas arbitrarias. El framework cubre una amplia superficie de capacidades de visión artificial, incluyendo la gestión de pipelines de datos para aumentar y estandarizar diversos conjuntos de datos OCR, entrenamiento de modelos con escalado distribuido y evaluación del rendimiento utilizando métricas OCR estándar. También proporciona utilidades para la manipulación de polígonos geométricos y visualización de resultados para auditar predicciones contra anotaciones de verdad fundamental. El sistema está implementado en Python y admite la instalación mediante empaquetado de entorno Docker.
Saves processed OCR data into structured industry-standard formats such as JSON or LMDB.
Open-Meteo is a free, open-source REST API that delivers weather forecasts, historical weather records, air quality data, marine conditions, solar radiation, and geocoding services. It aggregates data from dozens of freely licensed global and regional numerical weather models, making a broad set of environmental information accessible through a single API endpoint. The API uses a multi-model query router that automatically selects the most suitable model for any location, time range, and variable requested, while also allowing manual model choice. It handles unit and timezone conversion on th
Downloads query results in CSV or XLSX spreadsheet-compatible formats for offline analysis.
OpenEMR is an open-source electronic health record (EHR) system that also functions as a medical practice management platform and a patient portal, all integrated with standards-based health data exchange. It stores and manages patient health records, handles clinical workflows, supports scheduling and billing, and provides patients with secure self-service access to their information. Interoperability is built in via FHIR and C-CDA for exchanging records with external systems and Direct protocol for encrypted provider messaging. The system is designed to be extensible, with a modular plugin
Exports electronic health information in the B10 format for regulatory compliance and data exchange.
Seatbelt is a C# offensive security framework and host security auditor designed to perform endpoint surveys on Windows systems. It functions as a modular tool for identifying vulnerabilities, misconfigurations, and security-relevant artifacts on both local and remote hosts. The project distinguishes itself through a module-based check system that allows for the integration of custom security command units. It features a security event log parser to track logon and process activity, alongside a credential extraction utility for gathering browser history, saved passwords, and cloud credentials
Serializes collected security survey results into structured data formats like JSON and text for external analysis.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Converts database query results into common file formats like CSV, JSON, and SQL using built-in export plugins.
This project is a desktop-based bibliographic reference manager designed to organize academic research libraries and automate citation workflows. It functions as a research assistant that integrates directly with word processors and text editors, enabling users to insert and format references while writing. The application is built on a Java-based portable runtime, allowing it to operate as a self-contained tool that stores preferences and data in local configuration files. The platform distinguishes itself through a modular plugin architecture and a commitment to human-readable, text-based f
Produces highly tailored bibliographic exports with fixed date fields, automatic journal abbreviations, and auto-export on library changes.
dcat-admin is a Laravel admin panel framework used to rapidly build data-driven administration interfaces. It functions as a CRUD generator and backend scaffolding tool that automatically produces create, read, update, and delete interfaces based on database table schemas. The system distinguishes itself through a plugin-based extension architecture and the ability to run multiple independent administrative instances within a single installation. It provides specialized tools for mapping external APIs to forms and tables, as well as an event-driven form lifecycle for executing custom logic du
Provides the ability to define custom transformation logic for exporting table data into various file structures.
Chainsaw is a Windows forensic analysis tool used for parsing system databases and extracting security artefacts. It functions as a forensic artefact extractor and a scanner for identifying security threats and log tampering within Windows event logs. The project distinguishes itself by implementing a Sigma rule forensic scanner that applies standardized detection logic and custom rule sets to event logs and forensic artefacts. It enables threat hunting workflows by matching event data against patterns to identify malicious activity, lateral movement, and brute force attacks. The tool's capa
Converts raw forensic data into structured machine-readable formats suitable for external ingestion.