1 Repo
Awesome GitHub RepositoriesDocument Processing Flow Management
Utilities for chunking, reassembling, and sampling document data to optimize processing iterations.
Distinct from Data Flow Orchestrators: Distinct from general Data Flow Orchestrators: focuses specifically on document-level operations like chunking and sampling rather than service-to-service movement.
Explore 1 awesome GitHub repository matching data & databases · Document Processing Flow Management. Refine with filters or upvote what's useful.
Awesome Document Processing Flow Management GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- ucbepic/docetl
ucbepic/docetl
3,597Auf GitHub ansehendocetl is an AI-powered document ETL tool and map-reduce orchestrator designed to transform large collections of unstructured documents into structured, queryable tables using language models. It provides a declarative pipeline framework for extracting, cleaning, and transforming data from sources such as PDFs and text files into predefined schemas. The project distinguishes itself through a semantic data integration suite that enables joining datasets and resolving duplicate entities based on embedding-based similarity. It includes an interactive prompt playground for developing and optimizi
Provides tools for chunking documents and sampling subsets to accelerate data extraction iteration.
Pythonagentsdatadata-pipelines
