1 repository
Awesome GitHub RepositoriesParallel Partitioning Engines
Utilities for distributing document partitioning tasks across multiple processor cores to enable concurrent processing.
Distinct from Parallel Processing: Distinct from Parallel Processing: focuses on document partitioning specifically rather than general computational workload distribution.
Explore 1 awesome GitHub repository matching data & databases · Parallel Partitioning Engines. Refine with filters or upvote what's useful.
Awesome Parallel Partitioning Engines GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- unstructured-io/unstructured
Unstructured-IO/unstructured
14,019Vezi pe GitHubUnstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t
Splits large PDF files into page batches for concurrent processing to reduce total execution time.
HTMLdata-pipelinesdeep-learningdocument-image-analysis
