21 dépôts
Utilities for serializing and exporting scan results into structured data formats.
Distinguishing note: Focuses on the output capabilities of network scanning tools.
Explore 21 awesome GitHub repositories matching data & databases · Data Export Formats. Refine with filters or upvote what's useful.
Manim is a scriptable, code-driven framework designed for generating precise technical visualizations and mathematical animations. By using a high-level programming interface, it allows users to define geometric shapes, motion paths, and animation logic that are compiled into high-quality video assets. The system functions as a specialized engine for creating reproducible, data-driven representations of complex mathematical concepts and geometric transformations. The framework distinguishes itself through an interpolation-based engine that calculates intermediate states between keyframes to e
Manim produces output in standard formats to facilitate integration with external tools, data processing pipelines, or custom analysis software.
Langextract is a framework designed to transform unstructured text into structured, machine-readable data using language model orchestration. It provides a high-performance pipeline that processes large volumes of narrative text by utilizing parallel execution and sequential extraction passes. The library is built to handle complex data extraction tasks, including specialized support for clinical information and medical entity relationship recognition. The project distinguishes itself through a plugin-based architecture that supports both local hardware execution and cloud-hosted model endpoi
Saves and loads extracted data using the JSONL format for portability and easy integration.
Masscan is a command-line network scanner designed for large-scale discovery and infrastructure reconnaissance. It identifies open ports across specific network segments or the entire internet by probing vast address ranges with high efficiency. The tool functions as an asynchronous packet engine, bypassing standard operating system kernel networking stacks to transmit raw packets directly from application memory. The project distinguishes itself through a specialized architecture that manages millions of concurrent connections by separating packet transmission and reception into independent
Saves collected data into common formats like XML, JSON, or plain text for external processing.
cloc is a codebase metrics tool and multi-language code analyzer designed to count blank lines, comment lines, and physical lines of code. It serves as a source code line counter and report generator that identifies file types to calculate source volume across a wide variety of programming languages. The tool distinguishes itself by providing codebase version comparison to measure relative changes in source and comment lines between two versions of a directory or archive. It also supports the definition of custom languages and the extension of language recognition by loading custom comment fi
Serializes analysis results into structured data formats including JSON, XML, YAML, SQL, Markdown, and CSV.
This project is a Python-based framework that functions as a generative AI agent for programmatic data analysis. It enables users to interact with structured data sources through natural language prompts, translating these requests into executable code to perform analysis, data cleaning, and visualization. By maintaining conversational context across multi-turn interactions, the system allows for iterative exploration and the building of complex data narratives. The framework distinguishes itself through a robust semantic layer and secure execution model. It maps raw datasets to descriptive m
Exports generated visualizations to local storage in standard image formats.
bandwhich is a command-line network utility and terminal bandwidth monitor designed for real-time traffic analysis. It functions as a process-based traffic tracker that links network bandwidth usage directly to the system processes and remote hosts responsible for the data transfer. The tool provides a terminal user interface for monitoring active connections and identifying data-consuming applications. It performs background reverse DNS lookups to associate remote IP addresses with human-readable hostnames and tracks cumulative data utilization over the duration of a capture session. Its br
Serializes network statistics into delimited raw text formats for external analysis.
This project is a comprehensive geographic location dataset and reference library providing standardized data for countries, states, and cities. It serves as a source of truth for regional hierarchies, ISO codes, coordinates, and timezone information, available as both a relational SQL database and a document-based JSON library. The project includes a custom dataset export tool that functions as a filtering engine. This allows for the generation of tailored geographic files in JSON, CSV, and GeoJSON formats by selecting only the specific regions or fields required. The dataset covers global
Provides a filtering engine to generate tailored geographic files in JSON, CSV, or SQL.
Maltrail is a malicious traffic detection system used for network intrusion detection. It consists of a network intrusion sensor for monitoring interfaces, a threat intelligence aggregator for syncing blacklists, and a detection engine that identifies security threats through signature matching and heuristic attack patterns. The system distinguishes itself through a distributed sensor architecture that collects traffic data from multiple remote probes and forwards events to a central analysis server. It employs heuristic behavioral analysis to identify unknown threats, such as port scanning o
Sends detected threat logs to external monitoring systems using standardized formats like CEF or JSON via Syslog or Logstash.
LOLBAS is a curated database and knowledge base of signed Windows binaries that can be misused to bypass security restrictions and execute unauthorized code. It serves as a technical registry that maps trusted system files to their functional capabilities and the offensive tactics they enable. The project distinguishes itself by providing a capability-driven indexing system and a tactics registry that relates legitimate binary functionality to known security evasion techniques. It includes an association layer that links specific system binaries to attack patterns and tactical objectives, pro
Provides the ability to export the binary collection as JSON, CSV, or YAML files for external analysis.
Tabulator is an interactive data table library and virtual DOM data grid used to create high-performance tables from JSON or arrays. It functions as a hierarchical data viewer and a spreadsheet interface component, capable of rendering thousands of records efficiently through viewport-based virtualization and progressive loading. The library distinguishes itself by providing a full spreadsheet interface mode with multi-sheet management, cell range selection, and bulk copy-paste capabilities. It supports complex data architectures, including nested data field mapping, expandable tree structure
Transforms table data into specific file structures and MIME types using custom functions.
Trippy is a network diagnostic tool and terminal user interface that combines ping and traceroute functionality to analyze network paths and performance. It provides a network packet parser and path analyzer to detect packet loss, jitter, and multipath routing through continuous network probing. The project is distinguished by its support for specialized tracing strategies, including Paris and Dublin, to ensure consistent path discovery. It identifies network address translation devices and utilizes heuristic analysis to distinguish genuine packet loss from rate-limiting. Broad capability ar
Exports network scanning and tracing results into structured formats like JSON, CSV, and Graphviz DOT.
Make Zotero effective for us LaTeX holdouts
Produces highly tailored bibliographic exports with fixed date fields and automatic journal abbreviations.
mmocr est un framework de reconnaissance optique de caractères (OCR) basé sur PyTorch conçu pour entraîner et déployer des modèles de détection de texte, de reconnaissance et d'extraction d'informations clés. Il sert de boîte à outils complète pour la détection et la reconnaissance de texte dans les scènes, fournissant des bibliothèques spécialisées pour localiser les régions de texte et convertir le texte visuel en chaînes encodées par machine. Le projet se distingue par un framework de recherche pour l'extraction d'informations clés et des capacités avancées de repérage de texte. Celles-ci incluent le repérage basé sur des points utilisant des transformers et l'utilisation de courbes de Bezier paramétrées pour identifier et transcrire du texte de forme arbitraire. Le framework couvre une large surface de capacités de vision par ordinateur, notamment la gestion de pipeline de données pour augmenter et standardiser divers jeux de données OCR, l'entraînement de modèles avec mise à l'échelle distribuée et l'évaluation des performances utilisant des métriques OCR standard. Il fournit également des utilitaires pour la manipulation de polygones géométriques et la visualisation des résultats pour auditer les prédictions par rapport aux annotations de vérité terrain. Le système est implémenté en Python et prend en charge l'installation via l'empaquetage d'environnement Docker.
Saves processed OCR data into structured industry-standard formats such as JSON or LMDB.
Open-Meteo is a free, open-source REST API that delivers weather forecasts, historical weather records, air quality data, marine conditions, solar radiation, and geocoding services. It aggregates data from dozens of freely licensed global and regional numerical weather models, making a broad set of environmental information accessible through a single API endpoint. The API uses a multi-model query router that automatically selects the most suitable model for any location, time range, and variable requested, while also allowing manual model choice. It handles unit and timezone conversion on th
Downloads query results in CSV or XLSX spreadsheet-compatible formats for offline analysis.
OpenEMR is an open-source electronic health record (EHR) system that also functions as a medical practice management platform and a patient portal, all integrated with standards-based health data exchange. It stores and manages patient health records, handles clinical workflows, supports scheduling and billing, and provides patients with secure self-service access to their information. Interoperability is built in via FHIR and C-CDA for exchanging records with external systems and Direct protocol for encrypted provider messaging. The system is designed to be extensible, with a modular plugin
Exports electronic health information in the B10 format for regulatory compliance and data exchange.
Seatbelt est un framework de sécurité offensive C# et un auditeur de sécurité hôte conçu pour effectuer des enquêtes sur les points de terminaison (endpoints) sur les systèmes Windows. Il fonctionne comme un outil modulaire pour identifier les vulnérabilités, les mauvaises configurations et les artefacts liés à la sécurité sur les hôtes locaux et distants. Le projet se distingue par un système de vérification basé sur des modules qui permet l'intégration d'unités de commande de sécurité personnalisées. Il dispose d'un parseur de logs d'événements de sécurité pour suivre l'activité de connexion et de processus, ainsi qu'un utilitaire d'extraction d'identifiants pour collecter l'historique du navigateur, les mots de passe enregistrés et les identifiants cloud à partir des profils utilisateur. Le système couvre de larges domaines de capacité, notamment l'énumération de systèmes distants, la découverte d'hôtes basée sur le registre et l'analyse d'événements de sécurité. Il peut collecter des données de configuration système détaillées, telles que les paramètres antivirus et les règles réseau, et exporte les données d'enquête résultantes aux formats JSON ou texte.
Serializes collected security survey results into structured data formats like JSON and text for external analysis.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Converts database query results into common file formats like CSV, JSON, and SQL using built-in export plugins.
This project is a desktop-based bibliographic reference manager designed to organize academic research libraries and automate citation workflows. It functions as a research assistant that integrates directly with word processors and text editors, enabling users to insert and format references while writing. The application is built on a Java-based portable runtime, allowing it to operate as a self-contained tool that stores preferences and data in local configuration files. The platform distinguishes itself through a modular plugin architecture and a commitment to human-readable, text-based f
Produces highly tailored bibliographic exports with fixed date fields, automatic journal abbreviations, and auto-export on library changes.
dcat-admin est un framework de panneau d'administration Laravel utilisé pour construire rapidement des interfaces d'administration pilotées par les données. Il fonctionne comme un générateur de CRUD et un outil de scaffolding backend qui produit automatiquement des interfaces de création, lecture, mise à jour et suppression basées sur les schémas de tables de base de données. Le système se distingue par une architecture d'extension basée sur des plugins et la capacité d'exécuter plusieurs instances administratives indépendantes au sein d'une seule installation. Il fournit des outils spécialisés pour mapper des API externes vers des formulaires et des tableaux, ainsi qu'un cycle de vie de formulaire piloté par les événements pour exécuter une logique personnalisée lors de la résolution et de la soumission. Le framework couvre un large éventail de domaines de capacités, notamment le contrôle d'accès basé sur les rôles pour gérer les permissions hiérarchiques, une suite complète de grilles de gestion de données avec édition en ligne et des workflows de formulaires multi-étapes. Il inclut également des outils de visualisation de données pour les tableaux de bord opérationnels et une variété d'utilitaires de gestion de contenu pour les téléchargements de fichiers volumineux par morceaux et l'édition de texte riche. Des utilitaires en ligne de commande sont fournis pour automatiser la génération de composants administratifs et de classes d'action.
Provides the ability to define custom transformation logic for exporting table data into various file structures.
Chainsaw is a Windows forensic analysis tool used for parsing system databases and extracting security artefacts. It functions as a forensic artefact extractor and a scanner for identifying security threats and log tampering within Windows event logs. The project distinguishes itself by implementing a Sigma rule forensic scanner that applies standardized detection logic and custom rule sets to event logs and forensic artefacts. It enables threat hunting workflows by matching event data against patterns to identify malicious activity, lateral movement, and brute force attacks. The tool's capa
Converts raw forensic data into structured machine-readable formats suitable for external ingestion.