4 dépôts
Mechanisms for writing data to destinations in small chunks to optimize memory efficiency.
Distinct from Incremental Data Streaming: Specializes Incremental Data Streaming by focusing on the writable side of the stream rather than general processing.
Explore 4 awesome GitHub repositories matching data & databases · Incremental Writes. Refine with filters or upvote what's useful.
This project is a learning guide and collection of study notes designed to teach Node.js backend development. It provides a comprehensive core API reference and practical demonstrations for implementing server-side logic, network programming, and system APIs. The guide specifically covers advanced technical domains including process management for scaling applications via clusters and child processes, as well as network programming for building TCP, UDP, and HTTP services. It also includes detailed instructional material on security implementation, focusing on cryptographic hashing and encryp
Provides functionality to write data to files or network sockets in chunks until the stream closes.
Apache Fesod is a lightweight Java library that wraps Apache POI to provide a streaming API for reading and writing large Excel files. Its core identity is a low-memory spreadsheet processor that prevents out-of-memory errors by handling data row by row, never loading an entire document into memory at once. The library distinguishes itself through a listener-driven event model that fires row-level events to user code as each row is parsed, enabling incremental processing. It also includes an object mapping layer that maps spreadsheet rows directly to Java objects using configurable column map
Writes spreadsheet data incrementally to disk without building the full document in memory.
Wuhan2020 is an open platform for collecting, validating, and visualizing epidemic relief data, originally focused on coordinating community response during the COVID-19 crisis. It aggregates information on hospitals, factories, logistics providers, hotels, and donations from multiple sources into a central repository, making it accessible through an interactive geographic map and a programmatic API. The platform distinguishes itself by using GitHub issues as its primary data store, with label-driven organization and command-based task assignment that allows volunteers to claim and track work
Automatically imports data from collaborative spreadsheets into a central repository at scheduled intervals.
Ce projet est un tableau de bord d'activité physique et un pipeline de données qui agrège les statistiques de course et les itinéraires depuis des plateformes sportives externes dans un résumé visuel personnel. Il inclut un outil de migration de données de fitness pour consolider les enregistrements entre différents services sportifs et le stockage local, ainsi qu'un importateur de données pour traiter les fichiers GPX, TCX et FIT. Le système dispose d'un pipeline de synchronisation d'activité automatisé qui récupère périodiquement les données de fitness et redéploie un tableau de bord statique vers une plateforme d'hébergement. Il fournit également une interface utilisateur terminale pilotée par clavier pour filtrer et visualiser les statistiques de course et les listes d'activités localement. La plateforme couvre plusieurs domaines de capacité, incluant la visualisation de données d'activité via des graphiques SVG et des cartes interactives, l'archivage et la migration de données de fitness, et la synchronisation automatisée déclenchée par des workflows ou des raccourcis mobiles. L'interface web est construite en utilisant la génération de site statique avec routage côté client et en-têtes de sécurité pour gérer le trafic.
Implements a workflow that periodically fetches fitness data and redeploys a static dashboard.