1 Repo
Utilities for distributing document partitioning tasks across multiple processor cores to enable concurrent processing.
Distinct from Parallel Processing: Distinct from Parallel Processing: focuses on document partitioning specifically rather than general computational workload distribution.
Explore 1 awesome GitHub repository matching data & databases · Parallel Partitioning Engines. Refine with filters or upvote what's useful.
Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t
Splits large PDF files into page batches for concurrent processing to reduce total execution time.