2 Repos
Tools that compute descriptive statistics and value frequencies by scanning a dataset in a single pass.
Distinct from Metadata-Driven Optimizers: Existing candidates focus on query optimizers or lexicon analysis, not basic descriptive CSV statistics.
Explore 2 awesome GitHub repositories matching data & databases · Single-Pass Column Analyzers. Refine with filters or upvote what's useful.
xsv is a suite of high-performance command-line utilities written in Rust for the analysis, manipulation, and statistical processing of large delimited datasets. It provides a toolkit for processing comma-separated value files through a command line interface. The project provides capabilities for statistical analysis, including the computation of column statistics, value frequencies, and descriptive metrics. It also includes data manipulation utilities for joining, slicing, sampling, and reformatting records. The toolkit covers a broad range of data operations including column selection, da
Enables efficient computation of descriptive statistics and value frequencies using a single-pass scan of the dataset.
Amundsen is a data catalog and discovery platform that provides a centralized directory for indexing tables and dashboards. It functions as a metadata management system and search engine, allowing users to locate and understand available data assets across diverse distributed sources. The platform includes capabilities for data lineage tracking to map the origin and movement of datasets between systems. It also serves as a data profiling tool, calculating distribution and quality statistics for individual table columns to provide automated insights into the nature of the data. The system man
Computes descriptive statistics and value frequencies for table columns to reveal data quality insights.