1 Repo
Awesome GitHub RepositoriesMemory-Efficient Streaming
Processing large text streams in small segments to maintain a low memory footprint.
Distinct from Text Segmentation: Focuses on memory optimization during streaming rather than linguistic segmentation boundaries.
Explore 1 awesome GitHub repository matching data & databases · Memory-Efficient Streaming. Refine with filters or upvote what's useful.
Awesome Memory-Efficient Streaming GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- apache/tika
apache/tika
3,572Auf GitHub ansehenTika is a content analysis toolkit and Java library designed for detecting and extracting metadata and text from thousands of different file types. It functions as a universal document text extractor and metadata extraction engine, converting complex files into plain text or XHTML. The system employs a specialized MIME type detector that identifies document formats using magic bytes and metadata to determine the correct parser. It serves as an OCR integration gateway, connecting to external text recognition tools to extract content from image files. The project covers a broad range of extrac
Processes extracted text in small segments via custom handlers to minimize memory usage for large documents.
Javacontentextractionjava
