24 个仓库
Utilities for modifying delimiters, quoting rules, and record terminators in delimited files.
Distinct from CSV Processing: Candidates focus on JSON-to-CSV or HTML rendering, not the internal reformatting of CSV dialects.
Explore 24 awesome GitHub repositories matching data & databases · CSV Format Converters. Refine with filters or upvote what's useful.
PHPExcel is a PHP spreadsheet library used for programmatically reading and writing spreadsheet files in various formats. It utilizes an in-memory spreadsheet model that maps spreadsheet structures to a hierarchy of objects for programmatic manipulation. The library functions as an Office Open XML processor for generating and manipulating XLSX documents and serves as a reader for extracting data and structure from legacy binary XLS files. It also includes tools for CSV data integration and importing. The project provides capabilities for automated report generation and spreadsheet data extra
Includes tools to convert Excel spreadsheets into CSV format and vice versa.
xsv is a suite of high-performance command-line utilities written in Rust for the analysis, manipulation, and statistical processing of large delimited datasets. It provides a toolkit for processing comma-separated value files through a command line interface. The project provides capabilities for statistical analysis, including the computation of column statistics, value frequencies, and descriptive metrics. It also includes data manipulation utilities for joining, slicing, sampling, and reformatting records. The toolkit covers a broad range of data operations including column selection, da
Changes delimiters, record terminators, and quoting rules to ensure compatibility with other tools.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Transforms CSV files without headers into JSON by detecting the delimiter and assigning generic field names.
Feast is an open-source feature store for machine learning that provides a central platform for defining, storing, and serving features across both training and inference workflows. It operates as a declarative system where feature definitions are written as code in Python files, synchronized to a central registry, and made available for low-latency online retrieval or point-in-time correct historical joins for training datasets. The project abstracts storage behind a pluggable architecture, allowing offline and online backends to be swapped without changing retrieval logic, and coordinates ma
Outputs feature data as SQL queries or tables for use in other database tools.
csvkit is a composable Unix-style command-line toolkit for converting, filtering, and analyzing CSV files directly from the terminal. It provides a suite of focused single-purpose commands that can be combined via pipes to build complex data processing workflows, with a modular architecture that includes a column-type inference engine for automatically detecting data types and a streaming-pipeline design for efficient handling of tabular data. The toolkit distinguishes itself through its SQL-engine abstraction layer, which allows users to run SQL queries directly against CSV files without req
Converts Excel spreadsheets into CSV format using a single command-line invocation.
Responder is a network penetration testing tool that intercepts and spoofs link-local name resolution queries, including LLMNR, NBT-NS, and mDNS, to redirect traffic to an attacker-controlled host. It hosts rogue protocol servers for over 15 protocols, capturing authentication credentials during challenge-response handshakes, and stores captured hashes and cleartext credentials in a SQLite database for structured offline analysis. The tool distinguishes itself through its ability to relay captured NTLM authentication challenges to target services for lateral movement without cracking the hash
Exports collected authentication hashes from the internal SQLite database into CSV files.
pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos
Specifies field delimiters, enclosing characters, escape sequences, and header handling to match CSV file formats.
A lightweight client for managing MariaDB, MySQL, SQL Server, PostgreSQL, SQLite, Interbase and Firebird, written in Delphi and Lazarus/FreePascal
Generates SQL export files for structure and data with options to send to file, clipboard, or another server.
jscpd is a code duplication detector that scans source code across 223 languages to find identical or near-identical copy-pasted blocks using a rolling hash algorithm. It is built with a Rust core for high performance, exposed through a Node.js API and CLI, and can be run as a standalone binary with no runtime dependencies. The tool detects duplicates in embedded languages within Vue, Svelte, Astro, and Markdown files by tokenizing each language block separately, and it supports extensionless scripts via shebang detection. The project distinguishes itself through its integration capabilities
Exports duplication findings as CSV files for external data processing.
Goatcounter is a privacy-focused web analytics platform designed to be self-hosted on your own infrastructure. It collects visitor statistics like page views, browser information, location, screen size, and referring sites without using cookies or storing any personal data, identifying unique visits through a non-identifiable hash derived from browser and network data. The platform distinguishes itself by offering multiple tracking methods that respect user privacy, including a lightweight JavaScript snippet, an image-based tracking pixel for environments without JavaScript, and the ability t
Creates CSV exports of analytics data with status-check and download endpoints.
Goatcounter is a self-hosted web analytics platform that collects visitor statistics without cookies, personal data, or persistent identifiers. It uses privacy-preserving techniques like anonymous session hashing to count page views and visits, and can be deployed on your own infrastructure using a binary or Docker container with SQLite or PostgreSQL storage. The platform offers multiple data collection methods, including a lightweight JavaScript snippet, an image-based tracking pixel for environments where scripts are blocked, and server log file parsing from nginx, Apache, Caddy, or CloudFr
Creates a CSV export of analytics data for backup, migration, or offline analysis.
Allure is a test reporting framework that normalizes execution data from multiple test frameworks across different programming languages into a common intermediate format. It aggregates results from multiple sources into a shared directory of JSON files and generates self-contained HTML reports through a modular plugin pipeline. The architecture includes a hierarchical step tree model to represent test execution, metadata annotation injection to enrich results at runtime, and directory-watch incremental rendering that regenerates reports in real time as new data arrives. Unlike generic report
Generate a CSV file containing test execution data from the report, readable in spreadsheet tools.
CsvHelper is a library for reading and writing comma-separated value files by mapping data to custom class objects. It functions as a parsing library and data mapper that converts flat-file text into structured data objects and serializes internal data sets back into standard CSV files. The project emphasizes memory efficiency through a parser that optimizes resource consumption. It utilizes field value caching and an interned string cache to store repetitive values, which reduces memory overhead when processing large datasets. The library provides a configuration-driven parsing engine that
Allows precise control over field delimiters, escape sequences, and header handling through a configuration object.
Incus is a unified orchestration platform for managing system containers, OCI application containers, and virtual machines through a single control plane. It brings together cluster infrastructure management, secure multi-tenancy, software-defined networking, and pluggable storage backend orchestration into one cohesive system exposed via a full REST API and command-line interface. What distinguishes Incus is its ability to run multiple instance types side by side—full Linux system containers, OCI application containers, and QEMU virtual machines—all managed with consistent tooling. Networkin
Exports the internal database as SQL statements to aid in reconstructing networks, profiles, and other settings after a failure.
H2 是一个用 Java 编写的 JDBC 兼容关系型数据库管理系统。它作为一个可嵌入的 SQL 数据库,可以直接在应用程序进程内运行以消除网络延迟,或者作为内存数据库用于高性能的易失性存储。它还包含一个基于 Web 的控制台,用于执行 SQL 命令和管理模式。 该系统的特点是其灵活的部署模式,包括用于远程 TCP/IP 访问的独立服务器模式,以及用于同时进行本地和远程连接的混合模式。它具有方言模拟层和兼容模式,允许其模仿其他数据库系统的行为和语法。 该引擎提供了一套广泛的功能,涵盖具有多版本并发控制(MVCC)的 ACID 事务、地理空间和 JSON 数据支持,以及高级分析窗口函数。它包括通过压缩备份、SQL 脚本恢复和堆外内存管理来处理大数据集的数据保护工具。 该数据库使用标准的 Java 数据库连接驱动程序和连接 URL 与应用程序集成。
Converts database content into SQL scripts to facilitate data migration and restoration.
TablePro is a cross-platform database management client designed for browsing, querying, and administering both SQL and NoSQL databases. It functions as a unified workspace that integrates a code-centric SQL editor with schema visualization tools, allowing developers to manage complex data models and execute queries across diverse database engines. The application distinguishes itself through an agentic AI integration layer that connects language models directly to database tools, enabling automated query generation, optimization, and error fixing with configurable approval gates. It features
Writes database records to files with streaming support to handle datasets larger than available memory.
该库是一个 CSV 数据序列化和字符串化工具,用于将结构化记录转换为逗号分隔值。它提供了通过同步、基于回调或基于流的实现将数据记录转换为纯文本的工具。 该项目的特色在于通过原生的 Node.js Transform API 提供流式实现,允许在不将所有记录加载到内存的情况下处理大型数据集。它还包含一个灵活的格式化系统,用于定义特定的分隔符、引号、转义字符和标题配置。 该工具集涵盖数据导出自动化和记录到字符串的映射,支持从数据库记录或 API 响应中以编程方式生成文件。
Ships a configuration system for defining delimiters, quote characters, and header layouts in CSV output.
This project is a curated library of Python code examples, educational resources, and programming tutorials. It functions as an educational repository designed to teach Python language fundamentals through practical implementation tasks, real-world exercises, and functional code snippets. The collection covers a diverse range of implementation examples, including the development of interactive websites and message boards using web frameworks. It also features scripts for audio speech processing, automated media processing for images, and the extraction of data from web content. Additional ca
Reads Excel data and writes it into structured XML documents.
GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la
Provides configuration for CSV delimiters, quoting, and escape sequences to ensure correct parsing of administrative data files.
hledger is a plain text accounting tool and double-entry ledger manager that stores financial transactions in human-readable text files. It functions as a financial reporting engine for generating balance sheets and income statements, and as a multi-currency investment tracker for managing commodity lots and capital gains. The project distinguishes itself by providing multi-interface data access, allowing users to interact with their financial data via a command line interface, a terminal user interface, and a web server. It features a market-price valuation system to calculate the current va
Converts accounting transactions into a relational database format to enable complex queries and analysis.