7 repository-uri
Awesome GitHub RepositoriesRow-Based Result Streaming
Mechanisms for reading database records sequentially to minimize memory consumption for large datasets.
Distinct from Row Record Access: Candidates focus on visual styling or windowed access; this is about memory-efficient data streaming.
Explore 7 awesome GitHub repositories matching data & databases · Row-Based Result Streaming. Refine with filters or upvote what's useful.
Awesome Row-Based Result Streaming GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- felixge/node-mysql
felixge/node-mysql
18,621Vezi pe GitHubThis project is a pure JavaScript database driver for Node.js that implements the native MySQL binary protocol. It serves as a comprehensive connector for managing persistent network links to MySQL servers, enabling applications to execute queries, manage transactions, and handle complex data operations without requiring external middleware. The driver distinguishes itself through its integrated support for connection pooling and distributed database routing. It maintains managed sets of reusable network sockets to optimize resource usage under high request volumes, while simultaneously provi
Exposes query results as readable streams to allow memory-efficient handling of large datasets by processing rows as they arrive.
JavaScript - stackexchange/dapper
StackExchange/Dapper
18,320Vezi pe GitHubDapper is a high-performance micro-ORM and SQL object mapper for .NET. It functions as an ADO.NET extension library that adds data mapping capabilities directly to database connections, allowing SQL query results to be transformed into typed objects. The project prioritizes execution speed and low memory overhead by using intermediate language generation to map database columns to object properties. It further optimizes performance through the use of concurrent caching for mapping functions and literal value injection to improve database execution plans. The library covers a broad range of d
Reads database results one record at a time to minimize memory usage when handling large datasets.
C# - burntsushi/xsv
BurntSushi/xsv
10,750Vezi pe GitHubxsv is a suite of high-performance command-line utilities written in Rust for the analysis, manipulation, and statistical processing of large delimited datasets. It provides a toolkit for processing comma-separated value files through a command line interface. The project provides capabilities for statistical analysis, including the computation of column statistics, value frequencies, and descriptive metrics. It also includes data manipulation utilities for joining, slicing, sampling, and reformatting records. The toolkit covers a broad range of data operations including column selection, da
Processes records sequentially through a pipeline to maintain a low memory footprint for massive datasets.
Rust - tryghost/node-sqlite3
TryGhost/node-sqlite3
6,417Vezi pe GitHubnode-sqlite3 is a relational database client and a set of native bindings that allow Node.js applications to interact with SQLite databases. It functions as a C++ native addon, linking JavaScript to the SQLite C library to manage data stored in local files or in-memory stores. The project includes optional support for SQLCipher, enabling page-level encryption to secure local database files. The driver covers a wide range of database management capabilities, including executing SQL queries with parameter binding, managing connections to database files, and preparing statements for repeated ex
Processes large query result sets one row at a time via an iterator to minimize memory consumption.
PLpgSQL - go-pg/pg
go-pg/pg
5,785Vezi pe GitHubpg is a PostgreSQL object-relational mapper (ORM) for Go that maps Go structs to database tables and provides a fluent query builder for constructing SQL statements programmatically. At its core, it automatically generates CREATE TABLE statements from Go struct definitions using struct tags and naming conventions, and builds queries through method chaining with placeholder-based parameter binding to prevent SQL injection. The library distinguishes itself through relation-aware join generation that automatically constructs JOIN clauses for has-one, has-many, many-to-many, and polymorphic assoc
Processes query results row by row via a callback function without loading the entire result set into memory.
Go - rusqlite/rusqlite
rusqlite/rusqlite
4,058Vezi pe GitHubRusqlite is an embedded database interface and relational database driver that provides a client library for interacting with SQLite. It functions as an SQL query wrapper, enabling the management of local file-based or in-memory databases through a safe interface. The library allows for the extension of native database capabilities by implementing custom scalar functions, collations, and virtual tables. It also supports the embedding of the database engine directly into the application binary to remove external library dependencies. The project covers a broad range of capabilities including
Streams database records sequentially using lazy iteration to minimize memory consumption for large datasets.
Rustbindingsrustsqlite - encode/databases
encode/databases
4,002Vezi pe GitHubThis project is an asyncio database abstraction layer that provides a common interface for performing non-blocking database operations in Python. It functions as an asynchronous database driver wrapper and a SQL expression builder, allowing for the construction of raw SQL strings from structured Python objects. The library includes an asyncio connection pool manager that utilizes task-local storage to handle connection lifecycles and reduce resource overhead. It also serves as an async database transaction manager, wrapping operations in atomic transactions and savepoints to maintain data int
Iterates through database records sequentially using asynchronous cursors to prevent high memory consumption.
Python
