1 Repo
Awesome GitHub RepositoriesMemory-Efficient Column Selection
Techniques for loading only a specific subset of columns into memory to minimize the footprint of wide datasets.
Distinct from Column Value Extraction: Distinct from Column Value Extraction by focusing on the memory optimization of the load process rather than just the retrieval of values.
Explore 1 awesome GitHub repository matching data & databases · Memory-Efficient Column Selection. Refine with filters or upvote what's useful.
Awesome Memory-Efficient Column Selection GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- medialab/xan
medialab/xan
3,752Auf GitHub ansehenXan is a command-line tool and data transformation engine for processing CSV, TSV, and JSONL datasets. It functions as a processor for compressed files, enabling random access and seeking within gzipped and Zstd files, and serves as a converter for specialized bioinformatics data formats. The tool handles large datasets without requiring full memory loads by utilizing stream-based processing. It provides capabilities for merging, sorting, and deduplicating massive files, as well as converting data between various tabular formats. The project covers a broad range of data wrangling and analysi
Loads only requested data columns into memory to reduce the resource footprint when processing wide datasets.
Rustclicsvrust
