4 repositorios
Mechanisms for writing data to destinations in small chunks to optimize memory efficiency.
Distinct from Incremental Data Streaming: Specializes Incremental Data Streaming by focusing on the writable side of the stream rather than general processing.
Explore 4 awesome GitHub repositories matching data & databases · Incremental Writes. Refine with filters or upvote what's useful.
This project is a learning guide and collection of study notes designed to teach Node.js backend development. It provides a comprehensive core API reference and practical demonstrations for implementing server-side logic, network programming, and system APIs. The guide specifically covers advanced technical domains including process management for scaling applications via clusters and child processes, as well as network programming for building TCP, UDP, and HTTP services. It also includes detailed instructional material on security implementation, focusing on cryptographic hashing and encryp
Provides functionality to write data to files or network sockets in chunks until the stream closes.
Apache Fesod is a lightweight Java library that wraps Apache POI to provide a streaming API for reading and writing large Excel files. Its core identity is a low-memory spreadsheet processor that prevents out-of-memory errors by handling data row by row, never loading an entire document into memory at once. The library distinguishes itself through a listener-driven event model that fires row-level events to user code as each row is parsed, enabling incremental processing. It also includes an object mapping layer that maps spreadsheet rows directly to Java objects using configurable column map
Writes spreadsheet data incrementally to disk without building the full document in memory.
Wuhan2020 is an open platform for collecting, validating, and visualizing epidemic relief data, originally focused on coordinating community response during the COVID-19 crisis. It aggregates information on hospitals, factories, logistics providers, hotels, and donations from multiple sources into a central repository, making it accessible through an interactive geographic map and a programmatic API. The platform distinguishes itself by using GitHub issues as its primary data store, with label-driven organization and command-based task assignment that allows volunteers to claim and track work
Automatically imports data from collaborative spreadsheets into a central repository at scheduled intervals.
This project is a fitness activity dashboard and data pipeline that aggregates running statistics and routes from external sports platforms into a personal visual summary. It includes a fitness data migration tool for consolidating records between different sports services and local storage, alongside a data importer for processing GPX, TCX, and FIT files. The system features an automated activity sync pipeline that periodically fetches fitness data and redeploys a static dashboard to a hosting platform. It also provides a keyboard-driven terminal user interface for filtering and viewing runn
Implements a workflow that periodically fetches fitness data and redeploys a static dashboard.