4 Repos
Mechanisms for writing data to destinations in small chunks to optimize memory efficiency.
Distinct from Incremental Data Streaming: Specializes Incremental Data Streaming by focusing on the writable side of the stream rather than general processing.
Explore 4 awesome GitHub repositories matching data & databases · Incremental Writes. Refine with filters or upvote what's useful.
This project is a learning guide and collection of study notes designed to teach Node.js backend development. It provides a comprehensive core API reference and practical demonstrations for implementing server-side logic, network programming, and system APIs. The guide specifically covers advanced technical domains including process management for scaling applications via clusters and child processes, as well as network programming for building TCP, UDP, and HTTP services. It also includes detailed instructional material on security implementation, focusing on cryptographic hashing and encryp
Provides functionality to write data to files or network sockets in chunks until the stream closes.
Apache Fesod is a lightweight Java library that wraps Apache POI to provide a streaming API for reading and writing large Excel files. Its core identity is a low-memory spreadsheet processor that prevents out-of-memory errors by handling data row by row, never loading an entire document into memory at once. The library distinguishes itself through a listener-driven event model that fires row-level events to user code as each row is parsed, enabling incremental processing. It also includes an object mapping layer that maps spreadsheet rows directly to Java objects using configurable column map
Writes spreadsheet data incrementally to disk without building the full document in memory.
Wuhan2020 is an open platform for collecting, validating, and visualizing epidemic relief data, originally focused on coordinating community response during the COVID-19 crisis. It aggregates information on hospitals, factories, logistics providers, hotels, and donations from multiple sources into a central repository, making it accessible through an interactive geographic map and a programmatic API. The platform distinguishes itself by using GitHub issues as its primary data store, with label-driven organization and command-based task assignment that allows volunteers to claim and track work
Automatically imports data from collaborative spreadsheets into a central repository at scheduled intervals.
Dieses Projekt ist ein Fitness-Aktivitäts-Dashboard und eine Datenpipeline, die Laufstatistiken und Routen von externen Sportplattformen in einer persönlichen visuellen Zusammenfassung aggregiert. Es enthält ein Fitness-Daten-Migrationstool für die Konsolidierung von Datensätzen zwischen verschiedenen Sportdiensten und lokalem Speicher, sowie einen Daten-Importer für die Verarbeitung von GPX-, TCX- und FIT-Dateien. Das System bietet eine automatisierte Aktivitäts-Sync-Pipeline, die regelmäßig Fitnessdaten abruft und ein statisches Dashboard auf einer Hosting-Plattform neu bereitstellt. Es bietet zudem ein Tastatur-gesteuertes Terminal-UI für das Filtern und Anzeigen von Laufstatistiken und Aktivitätslisten lokal. Die Plattform deckt mehrere Funktionsbereiche ab, einschließlich Aktivitätsdatenvisualisierung durch SVG-Charts und interaktive Karten, Fitness-Datenarchivierung und -migration sowie automatisierte Synchronisierung, die durch Workflows oder mobile Shortcuts ausgelöst wird. Das Web-Interface ist mittels statischer Seitengenerierung mit Client-seitigem Routing und Sicherheits-Headern zur Verwaltung des Datenverkehrs aufgebaut.
Implements a workflow that periodically fetches fitness data and redeploys a static dashboard.