Xsv

xsv is a suite of high-performance command-line utilities written in Rust for the analysis, manipulation, and statistical processing of large delimited datasets. It provides a toolkit for processing comma-separated value files through a command line interface.

The project provides capabilities for statistical analysis, including the computation of column statistics, value frequencies, and descriptive metrics. It also includes data manipulation utilities for joining, slicing, sampling, and reformatting records.

The toolkit covers a broad range of data operations including column selection, data filtering, and structural modifications such as concatenating or splitting records. It further supports dataset indexing for faster row access and visual rendering of data as aligned tables.

Features

Command-Line Data Processors - Provides a comprehensive suite of high-performance Rust-based command-line tools for processing large CSV datasets.
CSV Command Line Toolkits - A high-performance suite of command-line tools for analyzing, filtering, and manipulating CSV data files.
CSV Processing - Provides a comprehensive toolkit for joining, slicing, sampling, and reformatting CSV records.
Column Manipulations - Allows extracting or re-ordering specific columns to refine the dataset output.
CSV Record Filters - Isolates CSV records using regular expressions and specific column value matching.
Data Joins - Provides high-performance inner, outer, and cross joins for combining large CSV datasets.
Frequency Analyzers - Builds frequency tables for each column to determine how often specific values occur.
Row-Based Result Streaming - Processes records sequentially through a pipeline to maintain a low memory footprint for massive datasets.
Single-Pass Column Analyzers - Enables efficient computation of descriptive statistics and value frequencies using a single-pass scan of the dataset.
Statistical Analysis Libraries - Calculates column statistics, value frequencies, and other descriptive metrics from CSV datasets.
CSV Descriptive Statistics - Calculates mean, median, standard deviation, and range for every data column in a CSV.
CSV Format Converters - Changes delimiters, record terminators, and quoting rules to ensure compatibility with other tools.
CSV Record Manipulators - Provides operations for concatenating, splitting, reversing, or padding CSV records.
CSV Row Indexes - Generates metadata indexes for CSV files to enable constant-time row access.
CSV Row Slicers - Extracts specific ranges of CSV rows using indices to avoid parsing the entire dataset.
Reservoir Samplers - Implements reservoir sampling to extract random subsets of data while keeping memory usage constant.
Offset-Based Addressing - Uses byte-offset indexing to provide constant-time random access to rows without parsing the entire file.
CSV and Tabular Data - Fast CSV indexing, slicing, and analysis.
Tabular Data Processing - High-performance CSV toolkit written in Rust.
Terminal Productivity - Fast CSV command-line toolkit.
Text Processing and Search - Fast CSV command line toolkit.

Istoric stele

Graficul istoricului de stele pentru burntsushi/xsv

BurntSushixsvArchived

Name: burntsushi/xsv
Author: BurntSushi

View on GitHub

10,750 stele326 fork-uriRustUnlicense8 vizualizări

Xsv

Features

Command-Line Data Processors - Provides a comprehensive suite of high-performance Rust-based command-line tools for processing large CSV datasets.
CSV Command Line Toolkits - A high-performance suite of command-line tools for analyzing, filtering, and manipulating CSV data files.
CSV Processing - Provides a comprehensive toolkit for joining, slicing, sampling, and reformatting CSV records.
Column Manipulations - Allows extracting or re-ordering specific columns to refine the dataset output.
CSV Record Filters - Isolates CSV records using regular expressions and specific column value matching.
Data Joins - Provides high-performance inner, outer, and cross joins for combining large CSV datasets.
Frequency Analyzers - Builds frequency tables for each column to determine how often specific values occur.
Row-Based Result Streaming - Processes records sequentially through a pipeline to maintain a low memory footprint for massive datasets.
Single-Pass Column Analyzers - Enables efficient computation of descriptive statistics and value frequencies using a single-pass scan of the dataset.
Statistical Analysis Libraries - Calculates column statistics, value frequencies, and other descriptive metrics from CSV datasets.
CSV Descriptive Statistics - Calculates mean, median, standard deviation, and range for every data column in a CSV.
CSV Format Converters - Changes delimiters, record terminators, and quoting rules to ensure compatibility with other tools.
CSV Record Manipulators - Provides operations for concatenating, splitting, reversing, or padding CSV records.
CSV Row Indexes - Generates metadata indexes for CSV files to enable constant-time row access.
CSV Row Slicers - Extracts specific ranges of CSV rows using indices to avoid parsing the entire dataset.
Reservoir Samplers - Implements reservoir sampling to extract random subsets of data while keeping memory usage constant.
Offset-Based Addressing - Uses byte-offset indexing to provide constant-time random access to rows without parsing the entire file.
CSV and Tabular Data - Fast CSV indexing, slicing, and analysis.
Tabular Data Processing - High-performance CSV toolkit written in Rust.
Terminal Productivity - Fast CSV command-line toolkit.
Text Processing and Search - Fast CSV command line toolkit.

Alternative open-source pentru Xsv

Proiecte open-source similare, clasificate după numărul de funcționalități comune cu Xsv.

medialab/xan
medialab/xan
3,752Vezi pe GitHub
Xan is a command-line tool and data transformation engine for processing CSV, TSV, and JSONL datasets. It functions as a processor for compressed files, enabling random access and seeking within gzipped and Zstd files, and serves as a converter for specialized bioinformatics data formats. The tool handles large datasets without requiring full memory loads by utilizing stream-based processing. It provides capabilities for merging, sorting, and deduplicating massive files, as well as converting data between various tabular formats. The project covers a broad range of data wrangling and analysi
Rustclicsvrust
Vezi pe GitHub3,752
wireservice/csvkit
wireservice/csvkit
6,390Vezi pe GitHub
csvkit is a composable Unix-style command-line toolkit for converting, filtering, and analyzing CSV files directly from the terminal. It provides a suite of focused single-purpose commands that can be combined via pipes to build complex data processing workflows, with a modular architecture that includes a column-type inference engine for automatically detecting data types and a streaming-pipeline design for efficient handling of tabular data. The toolkit distinguishes itself through its SQL-engine abstraction layer, which allows users to run SQL queries directly against CSV files without req
Python
Vezi pe GitHub6,390
dathere/qsv
dathere/qsv
3,687Vezi pe GitHub
qsv is a high-performance command line toolkit for querying, transforming, and analyzing comma-separated value files. It functions as a data wrangling interface and a tabular data profiler, featuring a query engine capable of executing SQL statements and joins directly on flat files without requiring a database. The project is distinguished by its ability to process massive datasets that exceed available system memory. This is achieved through disk-based external memory processing, including multithreaded merge sorting, on-disk hash tables for deduplication, and lightweight file indexing for
Rustaickancsv
Vezi pe GitHub3,687
saulpw/visidata
saulpw/visidata
8,834Vezi pe GitHub
VisiData is a terminal-based interactive data analysis tool and browser designed for exploring, filtering, and sorting large tabular datasets. It functions as a structured data inspector that loads and flattens complex formats like JSON, XML, and PCAP into interactive sheets, as well as a terminal file manager for navigating directories and performing staged filesystem operations. The project distinguishes itself by rendering data visualizations, such as scatter plots and histograms, directly in the terminal using Unicode Braille characters. It provides a Python-based data wrangling environme
Pythonclicsvdatajournalism
Vezi pe GitHub8,834

Vezi toate cele 30 alternative pentru Xsv

Întrebări frecvente

Ce face burntsushi/xsv?

Care sunt principalele funcționalități ale burntsushi/xsv?

Principalele funcționalități ale burntsushi/xsv sunt: Command-Line Data Processors, CSV Command Line Toolkits, CSV Processing, Column Manipulations, CSV Record Filters, Data Joins, Frequency Analyzers, Row-Based Result Streaming.

Care sunt câteva alternative open-source pentru burntsushi/xsv?

Alternativele open-source pentru burntsushi/xsv includ: medialab/xan — Xan is a command-line tool and data transformation engine for processing CSV, TSV, and JSONL datasets. It functions as… wireservice/csvkit — csvkit is a composable Unix-style command-line toolkit for converting, filtering, and analyzing CSV files directly… dathere/qsv — qsv is a high-performance command line toolkit for querying, transforming, and analyzing comma-separated value files.… saulpw/visidata — VisiData is a terminal-based interactive data analysis tool and browser designed for exploring, filtering, and sorting… hosseinmoein/dataframe — DataFrame is a C++ tabular data library and manipulation engine designed for managing heterogeneous data in contiguous… javascriptdata/danfojs — Danfo.js is a data analysis and preprocessing library for JavaScript that provides high-performance labeled data…