1 repository
Awesome GitHub RepositoriesMemory-Efficient Streaming
Processing large text streams in small segments to maintain a low memory footprint.
Distinct from Text Segmentation: Focuses on memory optimization during streaming rather than linguistic segmentation boundaries.
Explore 1 awesome GitHub repository matching data & databases · Memory-Efficient Streaming. Refine with filters or upvote what's useful.
Awesome Memory-Efficient Streaming GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- apache/tika
apache/tika
3,572Vezi pe GitHubTika is a content analysis toolkit and Java library designed for detecting and extracting metadata and text from thousands of different file types. It functions as a universal document text extractor and metadata extraction engine, converting complex files into plain text or XHTML. The system employs a specialized MIME type detector that identifies document formats using magic bytes and metadata to determine the correct parser. It serves as an OCR integration gateway, connecting to external text recognition tools to extract content from image files. The project covers a broad range of extrac
Processes extracted text in small segments via custom handlers to minimize memory usage for large documents.
Javacontentextractionjava
