6 个仓库
Applying SQL queries to analyze structured text files without database imports.
Distinguishing note: Existing candidates focus on SQL scripts or performance analysis rather than analyzing raw text files using SQL
Explore 6 awesome GitHub repositories matching data & databases · Flat-File SQL Analysis. Refine with filters or upvote what's useful.
TextQL is a command line SQL query engine designed to execute relational queries directly against structured text files, such as CSV and TSV, without requiring a database import. It functions as a relational text file analyzer and a CSV processor that treats plain text files as virtual tables for filtering, joining, and aggregating data. The tool is built as a pipe-compatible data transformation utility, allowing it to process data from standard input and output formatted datasets. It enables relational joins across multiple files or directories within a single query to analyze relationships
Allows running SQL queries on CSV or TSV files to filter and aggregate data without importing it into a database.
Perfetto is a platform for system-level performance tracing and analysis on Linux and Android. It combines a high-throughput trace recorder, a SQL-based query engine, and a browser-based visualizer into a single toolchain. The platform covers CPU scheduling and call-stack profiling, native and Java heap memory allocation tracking, GPU and graphics events, and system-wide counters such as CPU frequency and power consumption. The architecture decouples trace recording from offline analysis, using a compact protobuf format for event encoding and columnar storage for efficient SQL queries. The we
Applies SQL queries to analyze structured profiling data imported from pprof files.
Briefer is an interactive data notebook platform and business intelligence dashboard tool used for collaborative data analysis and reporting. It provides a containerized environment for building reports that combine SQL, Python, and Markdown with native visualizations. The platform features an integrated code assistant that uses large language models to generate SQL and Python snippets from natural language prompts. It is designed as a Kubernetes data application, deploying via Helm charts to manage isolated compute environments and ensure separate resources per page through pod-based isolati
Allows importing local files to be analyzed using SQL queries without needing a formal database import.
Franchise 是一个数据库查询工具和笔记本 SQL 客户端,允许用户运行查询并分析数据集。它作为一个本地数据处理器,具有一个基于浏览器的引擎,用于针对 CSV、JSON 和 XLSX 文件执行 SQL 命令,而无需将数据上传到远程服务器。 该项目使用基于单元格的界面以交互式的文档布局组织查询和结果。它支持一种工作流,用户可以将查询分支为并排布局,以比较不同的 SQL 变体及其结果,而无需覆盖现有代码。 该系统提供了一个统一的界面,用于通过安全本地网桥连接到远程数据库,并包括将表格结果转换为图表、地图和卡片视图的工具。这些交互式笔记本及其相关的可视化可以导出为便携式 HTML 文档。 该应用程序被打包为独立资产,用于在标准 HTTP 服务器上托管。
Applies SQL queries to analyze structured local files like CSV, JSON, and XLSX without requiring database imports.
dsq is a command-line interface and data engine for executing SQL queries against local structured files, such as CSV, JSON, Parquet, and Excel, without requiring a formal database import. It functions as a schema-inference engine that automatically detects data types and maps heterogeneous file structures into relational tables for analysis. The tool utilizes a lazy stream data processor and checksum-based disk caching to handle large datasets with minimal memory usage. It provides a persistent interactive shell for iterative data exploration, allowing users to inspect inferred schemas and r
Executes SQL queries against CSV, JSON, and Parquet files without importing them into a formal database engine.
qsv is a high-performance command line toolkit for querying, transforming, and analyzing comma-separated value files. It functions as a data wrangling interface and a tabular data profiler, featuring a query engine capable of executing SQL statements and joins directly on flat files without requiring a database. The project is distinguished by its ability to process massive datasets that exceed available system memory. This is achieved through disk-based external memory processing, including multithreaded merge sorting, on-disk hash tables for deduplication, and lightweight file indexing for
Executes complex SQL queries and joins directly on flat CSV files without requiring a database engine.