2 Repos
On-demand processing pipelines for mapping, filtering, and reducing data streams.
Distinct from Lazy Stream Sources: Candidates focus on specific target streaming or DOM events; this is a general functional programming stream utility.
Explore 2 awesome GitHub repositories matching data & databases · Lazy Stream Processing. Refine with filters or upvote what's useful.
Lancet is a comprehensive extension of the Go standard library, providing a collection of reusable functions and data structures designed to reduce boilerplate code in applications. It serves as a general-purpose toolkit across multiple domains, including concurrency, security, networking, and functional logic. The project distinguishes itself through specialized toolkits for Go concurrency, such as keyed locking and channel-based stream processing, and a dedicated functional programming kit that supports currying and function composition. It also includes a dedicated cryptography library imp
Creates lazy streams from slices or channels to perform mapping, filtering, and reduction.
dsq is a command-line interface and data engine for executing SQL queries against local structured files, such as CSV, JSON, Parquet, and Excel, without requiring a formal database import. It functions as a schema-inference engine that automatically detects data types and maps heterogeneous file structures into relational tables for analysis. The tool utilizes a lazy stream data processor and checksum-based disk caching to handle large datasets with minimal memory usage. It provides a persistent interactive shell for iterative data exploration, allowing users to inspect inferred schemas and r
Processes records one by one from source files to minimize memory usage during large dataset operations.