21 Repos
Utilities for serializing and exporting scan results into structured data formats.
Distinguishing note: Focuses on the output capabilities of network scanning tools.
Explore 21 awesome GitHub repositories matching data & databases · Data Export Formats. Refine with filters or upvote what's useful.
Manim is a scriptable, code-driven framework designed for generating precise technical visualizations and mathematical animations. By using a high-level programming interface, it allows users to define geometric shapes, motion paths, and animation logic that are compiled into high-quality video assets. The system functions as a specialized engine for creating reproducible, data-driven representations of complex mathematical concepts and geometric transformations. The framework distinguishes itself through an interpolation-based engine that calculates intermediate states between keyframes to e
Manim produces output in standard formats to facilitate integration with external tools, data processing pipelines, or custom analysis software.
Langextract is a framework designed to transform unstructured text into structured, machine-readable data using language model orchestration. It provides a high-performance pipeline that processes large volumes of narrative text by utilizing parallel execution and sequential extraction passes. The library is built to handle complex data extraction tasks, including specialized support for clinical information and medical entity relationship recognition. The project distinguishes itself through a plugin-based architecture that supports both local hardware execution and cloud-hosted model endpoi
Saves and loads extracted data using the JSONL format for portability and easy integration.
Masscan is a command-line network scanner designed for large-scale discovery and infrastructure reconnaissance. It identifies open ports across specific network segments or the entire internet by probing vast address ranges with high efficiency. The tool functions as an asynchronous packet engine, bypassing standard operating system kernel networking stacks to transmit raw packets directly from application memory. The project distinguishes itself through a specialized architecture that manages millions of concurrent connections by separating packet transmission and reception into independent
Saves collected data into common formats like XML, JSON, or plain text for external processing.
cloc is a codebase metrics tool and multi-language code analyzer designed to count blank lines, comment lines, and physical lines of code. It serves as a source code line counter and report generator that identifies file types to calculate source volume across a wide variety of programming languages. The tool distinguishes itself by providing codebase version comparison to measure relative changes in source and comment lines between two versions of a directory or archive. It also supports the definition of custom languages and the extension of language recognition by loading custom comment fi
Serializes analysis results into structured data formats including JSON, XML, YAML, SQL, Markdown, and CSV.
This project is a Python-based framework that functions as a generative AI agent for programmatic data analysis. It enables users to interact with structured data sources through natural language prompts, translating these requests into executable code to perform analysis, data cleaning, and visualization. By maintaining conversational context across multi-turn interactions, the system allows for iterative exploration and the building of complex data narratives. The framework distinguishes itself through a robust semantic layer and secure execution model. It maps raw datasets to descriptive m
Exports generated visualizations to local storage in standard image formats.
bandwhich is a command-line network utility and terminal bandwidth monitor designed for real-time traffic analysis. It functions as a process-based traffic tracker that links network bandwidth usage directly to the system processes and remote hosts responsible for the data transfer. The tool provides a terminal user interface for monitoring active connections and identifying data-consuming applications. It performs background reverse DNS lookups to associate remote IP addresses with human-readable hostnames and tracks cumulative data utilization over the duration of a capture session. Its br
Serializes network statistics into delimited raw text formats for external analysis.
This project is a comprehensive geographic location dataset and reference library providing standardized data for countries, states, and cities. It serves as a source of truth for regional hierarchies, ISO codes, coordinates, and timezone information, available as both a relational SQL database and a document-based JSON library. The project includes a custom dataset export tool that functions as a filtering engine. This allows for the generation of tailored geographic files in JSON, CSV, and GeoJSON formats by selecting only the specific regions or fields required. The dataset covers global
Provides a filtering engine to generate tailored geographic files in JSON, CSV, or SQL.
Maltrail is a malicious traffic detection system used for network intrusion detection. It consists of a network intrusion sensor for monitoring interfaces, a threat intelligence aggregator for syncing blacklists, and a detection engine that identifies security threats through signature matching and heuristic attack patterns. The system distinguishes itself through a distributed sensor architecture that collects traffic data from multiple remote probes and forwards events to a central analysis server. It employs heuristic behavioral analysis to identify unknown threats, such as port scanning o
Sends detected threat logs to external monitoring systems using standardized formats like CEF or JSON via Syslog or Logstash.
LOLBAS is a curated database and knowledge base of signed Windows binaries that can be misused to bypass security restrictions and execute unauthorized code. It serves as a technical registry that maps trusted system files to their functional capabilities and the offensive tactics they enable. The project distinguishes itself by providing a capability-driven indexing system and a tactics registry that relates legitimate binary functionality to known security evasion techniques. It includes an association layer that links specific system binaries to attack patterns and tactical objectives, pro
Provides the ability to export the binary collection as JSON, CSV, or YAML files for external analysis.
Tabulator is an interactive data table library and virtual DOM data grid used to create high-performance tables from JSON or arrays. It functions as a hierarchical data viewer and a spreadsheet interface component, capable of rendering thousands of records efficiently through viewport-based virtualization and progressive loading. The library distinguishes itself by providing a full spreadsheet interface mode with multi-sheet management, cell range selection, and bulk copy-paste capabilities. It supports complex data architectures, including nested data field mapping, expandable tree structure
Transforms table data into specific file structures and MIME types using custom functions.
Trippy is a network diagnostic tool and terminal user interface that combines ping and traceroute functionality to analyze network paths and performance. It provides a network packet parser and path analyzer to detect packet loss, jitter, and multipath routing through continuous network probing. The project is distinguished by its support for specialized tracing strategies, including Paris and Dublin, to ensure consistent path discovery. It identifies network address translation devices and utilizes heuristic analysis to distinguish genuine packet loss from rate-limiting. Broad capability ar
Exports network scanning and tracing results into structured formats like JSON, CSV, and Graphviz DOT.
Make Zotero effective for us LaTeX holdouts
Produces highly tailored bibliographic exports with fixed date fields and automatic journal abbreviations.
mmocr ist ein auf PyTorch basierendes Framework für optische Zeichenerkennung (OCR), das für das Training und Deployment von Modellen zur Texterkennung, -identifizierung und Extraktion von Schlüsselinformationen entwickelt wurde. Es dient als umfassende Toolbox für die Erkennung und Identifizierung von Text in Szenen und bietet spezialisierte Bibliotheken zum Lokalisieren von Textregionen und zum Konvertieren von visuellem Text in maschinell kodierte Strings. Das Projekt zeichnet sich durch ein Forschungs-Framework für die Extraktion von Schlüsselinformationen und fortgeschrittene Text-Spotting-Funktionen aus. Dazu gehören punktbasiertes Spotting mittels Transformern und die Verwendung parametrisierter Bezier-Kurven, um beliebig geformten Text zu identifizieren und zu transkribieren. Das Framework deckt ein breites Spektrum an Computer-Vision-Funktionen ab, einschließlich Daten-Pipeline-Management zur Augmentierung und Standardisierung diverser OCR-Datensätze, Modelltraining mit verteilter Skalierung und Performance-Evaluierung unter Verwendung von Standard-OCR-Metriken. Es bietet zudem Dienstprogramme für geometrische Polygon-Manipulation und Ergebnisvisualisierung zur Überprüfung von Vorhersagen gegen Ground-Truth-Annotationen. Das System ist in Python implementiert und unterstützt die Installation über Docker-Umgebungs-Packaging.
Saves processed OCR data into structured industry-standard formats such as JSON or LMDB.
Open-Meteo is a free, open-source REST API that delivers weather forecasts, historical weather records, air quality data, marine conditions, solar radiation, and geocoding services. It aggregates data from dozens of freely licensed global and regional numerical weather models, making a broad set of environmental information accessible through a single API endpoint. The API uses a multi-model query router that automatically selects the most suitable model for any location, time range, and variable requested, while also allowing manual model choice. It handles unit and timezone conversion on th
Downloads query results in CSV or XLSX spreadsheet-compatible formats for offline analysis.
OpenEMR is an open-source electronic health record (EHR) system that also functions as a medical practice management platform and a patient portal, all integrated with standards-based health data exchange. It stores and manages patient health records, handles clinical workflows, supports scheduling and billing, and provides patients with secure self-service access to their information. Interoperability is built in via FHIR and C-CDA for exchanging records with external systems and Direct protocol for encrypted provider messaging. The system is designed to be extensible, with a modular plugin
Exports electronic health information in the B10 format for regulatory compliance and data exchange.
Seatbelt ist ein C#-Framework für offensive Sicherheit und ein Host-Sicherheitsauditor, das für Endpoint-Surveys auf Windows-Systemen entwickelt wurde. Es fungiert als modulares Tool zur Identifizierung von Schwachstellen, Fehlkonfigurationen und sicherheitsrelevanten Artefakten auf lokalen und Remote-Hosts. Das Projekt zeichnet sich durch ein modulbasiertes Prüfsystem aus, das die Integration benutzerdefinierter Sicherheitsbefehlseinheiten ermöglicht. Es verfügt über einen Parser für Sicherheitsereignisprotokolle zur Verfolgung von Anmelde- und Prozessaktivitäten sowie ein Utility zur Anmeldeinformationsextraktion, um Browserverlauf, gespeicherte Passwörter und Cloud-Anmeldedaten aus Benutzerprofilen zu sammeln. Das System deckt breite Funktionsbereiche ab, einschließlich Remote-System-Enumeration, Registry-basierter Host-Erkennung und Sicherheitsereignisanalyse. Es kann detaillierte Systemkonfigurationsdaten, wie Antivirus-Einstellungen und Netzwerkregeln, erfassen und die resultierenden Survey-Daten in JSON- oder Textformate exportieren.
Serializes collected security survey results into structured data formats like JSON and text for external analysis.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Converts database query results into common file formats like CSV, JSON, and SQL using built-in export plugins.
This project is a desktop-based bibliographic reference manager designed to organize academic research libraries and automate citation workflows. It functions as a research assistant that integrates directly with word processors and text editors, enabling users to insert and format references while writing. The application is built on a Java-based portable runtime, allowing it to operate as a self-contained tool that stores preferences and data in local configuration files. The platform distinguishes itself through a modular plugin architecture and a commitment to human-readable, text-based f
Produces highly tailored bibliographic exports with fixed date fields, automatic journal abbreviations, and auto-export on library changes.
dcat-admin ist ein Laravel-Admin-Panel-Framework, das verwendet wird, um datengesteuerte Administrationsschnittstellen schnell zu erstellen. Es fungiert als CRUD-Generator und Backend-Scaffolding-Tool, das automatisch Schnittstellen zum Erstellen, Lesen, Aktualisieren und Löschen basierend auf Datenbanktabellenschemata produziert. Das System zeichnet sich durch eine plugin-basierte Erweiterungsarchitektur und die Möglichkeit aus, mehrere unabhängige administrative Instanzen innerhalb einer einzigen Installation auszuführen. Es bietet spezialisierte Tools für das Mapping externer APIs auf Formulare und Tabellen sowie einen ereignisgesteuerten Formular-Lebenszyklus für die Ausführung benutzerdefinierter Logik während der Auflösung und Übermittlung. Das Framework deckt ein breites Spektrum an Funktionsbereichen ab, einschließlich rollenbasierter Zugriffskontrolle für die Verwaltung hierarchischer Berechtigungen, einer umfassenden Suite von Datenverwaltungs-Grids mit Inline-Bearbeitung und mehrstufigen Formular-Workflows. Es enthält zudem Datenvisualisierungstools für operative Dashboards und eine Vielzahl von Content-Handling-Utilities für stückweise große Datei-Uploads und Rich-Text-Bearbeitung. Kommandozeilen-Utilities werden bereitgestellt, um die Generierung administrativer Komponenten und Action-Klassen zu automatisieren.
Provides the ability to define custom transformation logic for exporting table data into various file structures.
Chainsaw is a Windows forensic analysis tool used for parsing system databases and extracting security artefacts. It functions as a forensic artefact extractor and a scanner for identifying security threats and log tampering within Windows event logs. The project distinguishes itself by implementing a Sigma rule forensic scanner that applies standardized detection logic and custom rule sets to event logs and forensic artefacts. It enables threat hunting workflows by matching event data against patterns to identify malicious activity, lateral movement, and brute force attacks. The tool's capa
Converts raw forensic data into structured machine-readable formats suitable for external ingestion.