2 repositorios
Joining datasets via virtual links to avoid copying data into new memory objects.
Distinct from Data Joins: Avoids the physical materialization of join results, whereas general data joins typically create new objects.
Explore 2 awesome GitHub repositories matching data & databases · Deferred Materialization. Refine with filters or upvote what's useful.
Vaex is a high-performance Apache Arrow DataFrame library and out-of-core data processing engine designed to handle billion-row tabular datasets in Python. It functions as a lazy evaluation framework that defers computations and transformations until results are required, enabling the processing of datasets that exceed available system RAM by mapping files directly from disk. The project distinguishes itself as a tool for big data visualization and exploration, specifically integrated for use within interactive notebooks. It provides specialized capabilities for machine learning feature engin
Provides deferred materialization joins that link datasets virtually to minimize memory consumption during large-scale merges.
magic-string is a low-level JavaScript library designed for compilers and bundlers to perform source code transformations. It serves as a string transformation utility and source map manipulation library that allows for modifying text while automatically tracking character offsets. The library enables the modification of source code strings through insertions, replacements, and removals without losing the relationship to original source positions. It specifically provides mechanisms to generate mapping files that link transformed output text back to original source file coordinates. Capabili
Implements deferred string materialization to optimize performance by queuing edits before generating the final output.