monitorjbl/excel-streaming-reader
Excel Streaming Reader
Excel Streaming Reader is a Java library designed for processing massive spreadsheet files by reading data incrementally. It functions as a memory-efficient parser that prevents system memory exhaustion by avoiding the need to load entire documents into memory at once.
The library utilizes an event-driven approach to translate low-level XML parsing events into high-level row and cell objects. By implementing streaming row iteration, it exposes data through a sequential cursor interface that maintains only a small, configurable subset of rows in memory during the extraction process.
To support the handling of large datasets, the library incorporates resource-managed stream handling and temporary file buffering. These mechanisms ensure that input streams are processed from disk and that temporary files are automatically cleaned up upon completion, providing a stable environment for high-performance data extraction workflows built on top of Apache POI.
Features
- Spreadsheet Streaming Libraries - Provides a memory-efficient library for processing massive spreadsheet files by reading data incrementally.
- Streaming Parsers - Processes large spreadsheet files by reading the underlying XML structure incrementally to avoid loading the entire document into memory.
- Spreadsheet Row Streaming - Exposes spreadsheet data through a sequential cursor interface that keeps only a small, configurable subset of rows active in memory.
- Large Scale Processing - Reads massive Excel files incrementally to extract data without consuming excessive system memory.
- Row Iterators - Provides iterative access to individual rows and cells to handle large datasets efficiently without loading the entire file into memory.
- Memory-Efficient Data Streaming - Provides a utility for streaming input from disk to handle large datasets while maintaining a small memory footprint.
- Memory-Efficient Scanning - Processes large datasets from disk by keeping only a small subset of rows active in memory at any given time.
- Event-Driven Row Parsers - Translates low-level XML parsing events into high-level row and cell objects for efficient, memory-conscious data extraction.
- Stream Resource Management - Ensures system stability by automatically managing the lifecycle of input streams and temporary files during data processing.
- Temporary File Cleanup - Automates the creation and removal of temporary files used for buffering input streams during data processing.
- Temporary Storage Managers - Offloads large input streams to disk-based temporary storage to maintain a low memory footprint during the parsing process.
