1 dépôt
Awesome GitHub RepositoriesDocument Processing Flow Management
Utilities for chunking, reassembling, and sampling document data to optimize processing iterations.
Distinct from Data Flow Orchestrators: Distinct from general Data Flow Orchestrators: focuses specifically on document-level operations like chunking and sampling rather than service-to-service movement.
Explore 1 awesome GitHub repository matching data & databases · Document Processing Flow Management. Refine with filters or upvote what's useful.
Awesome Document Processing Flow Management GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- ucbepic/docetl
ucbepic/docetl
3,597Voir sur GitHubdocetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi
Provides tools for chunking documents and sampling subsets to accelerate data extraction iteration.
Pythonagentsdatadata-pipelines
