4 repository-uri
Mechanisms for writing data to destinations in small chunks to optimize memory efficiency.
Distinct from Incremental Data Streaming: Specializes Incremental Data Streaming by focusing on the writable side of the stream rather than general processing.
Explore 4 awesome GitHub repositories matching data & databases · Incremental Writes. Refine with filters or upvote what's useful.
This project is a learning guide and collection of study notes designed to teach Node.js backend development. It provides a comprehensive core API reference and practical demonstrations for implementing server-side logic, network programming, and system APIs. The guide specifically covers advanced technical domains including process management for scaling applications via clusters and child processes, as well as network programming for building TCP, UDP, and HTTP services. It also includes detailed instructional material on security implementation, focusing on cryptographic hashing and encryp
Provides functionality to write data to files or network sockets in chunks until the stream closes.
Apache Fesod is a lightweight Java library that wraps Apache POI to provide a streaming API for reading and writing large Excel files. Its core identity is a low-memory spreadsheet processor that prevents out-of-memory errors by handling data row by row, never loading an entire document into memory at once. The library distinguishes itself through a listener-driven event model that fires row-level events to user code as each row is parsed, enabling incremental processing. It also includes an object mapping layer that maps spreadsheet rows directly to Java objects using configurable column map
Writes spreadsheet data incrementally to disk without building the full document in memory.
Wuhan2020 is an open platform for collecting, validating, and visualizing epidemic relief data, originally focused on coordinating community response during the COVID-19 crisis. It aggregates information on hospitals, factories, logistics providers, hotels, and donations from multiple sources into a central repository, making it accessible through an interactive geographic map and a programmatic API. The platform distinguishes itself by using GitHub issues as its primary data store, with label-driven organization and command-based task assignment that allows volunteers to claim and track work
Automatically imports data from collaborative spreadsheets into a central repository at scheduled intervals.
Acest proiect este un dashboard de activitate fizică și un pipeline de date care agregă statisticile de alergare și rutele din platforme sportive externe într-un rezumat vizual personal. Include un instrument de migrare a datelor de fitness pentru consolidarea înregistrărilor între diferite servicii sportive și stocarea locală, alături de un importator de date pentru procesarea fișierelor GPX, TCX și FIT. Sistemul dispune de un pipeline automat de sincronizare a activităților care preia periodic datele de fitness și redeployează un dashboard static pe o platformă de găzduire. De asemenea, oferă o interfață de linie de comandă (TUI) controlată prin tastatură pentru filtrarea și vizualizarea statisticilor de alergare și a listelor de activități local. Platforma acoperă mai multe arii de capabilități, inclusiv vizualizarea datelor de activitate prin grafice SVG și hărți interactive, arhivarea și migrarea datelor de fitness și sincronizarea automată declanșată de workflow-uri sau scurtături mobile. Interfața web este construită folosind generarea de site-uri statice cu rutare client-side și headere de securitate pentru a gestiona traficul.
Implements a workflow that periodically fetches fitness data and redeploys a static dashboard.