Awesome GitHub RepositoriesStructured Document Extraction

PaddleOCR is a comprehensive optical character recognition framework designed for detecting and transcribing text from images and documents into structured, machine-readable formats. It provides a modular computer vision pipeline that decouples image preprocessing, text detection, and character recognition into independent, configurable stages. This architecture supports automated document digitization and multilingual text recognition, capable of identifying text in over one hundred languages across diverse environments ranging from scanned documents to industrial scenes. The framework disti

MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data. It utilizes deep learning models to perform layout analysis, identifying document regions and extracting complex content such as mathematical expressions. By combining these neural network inferences with geometric heuristics, the system reconstructs the reading order and structural hierarchy of documents to ensure accurate data representation. The project distinguishes itself through a multi-stage processing workflow that integrates layout detection, optical character recogn

PageIndex is an agent-ready knowledge engine that processes documents into hierarchical tree structures to enable reasoning-based information retrieval. By organizing content into logical trees rather than relying on traditional vector database chunking, the platform preserves the original structure and flow of complex documents. It functions as a Model Context Protocol server, allowing external AI agents to connect to and query indexed knowledge bases through standardized communication protocols. The platform distinguishes itself by using vision-language models to process raw document images

This project is a high-performance headless browser engine designed for scalable web automation, data extraction, and AI agent integration. It provides a specialized environment that allows autonomous agents and testing frameworks to interact with web content through standardized remote control protocols. By executing pages in a lightweight, headless state, the engine minimizes resource consumption while maintaining the ability to perform complex navigation and dynamic content rendering. The platform distinguishes itself through deep integration with AI-centric communication layers and advanc

This project is a PDF data extraction tool and document preprocessor designed to convert PDF files into structured formats such as Markdown, JSON, and HTML. It functions as an OCR document parser for scanned files, an accessibility automator for generating PDF/UA compliant metadata, and a loader for AI orchestration frameworks like LangChain. The software distinguishes itself through specialized handling of complex document elements, including the conversion of mathematical formulas into LaTeX and the generation of natural-language descriptions for charts and images. It utilizes recursive seg

Kotaemon is an orchestration framework designed for building modular, agentic workflows that integrate document processing, retrieval-augmented generation, and multi-step reasoning. It provides a comprehensive platform for developing document-based question answering systems, allowing users to chain language models, prompt templates, and external tools into complex, automated pipelines. The system distinguishes itself through a highly modular architecture that emphasizes component-based composition and schema-driven data exchange. It supports autonomous agents capable of decomposing complex q

This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based models across multimodal, document intelligence, and natural language processing tasks. It provides a unified neural architecture that processes text, vision, audio, and document layout data through a shared set of weights, enabling researchers and developers to build foundational models that align cross-modal representations. The platform distinguishes itself through advanced training and inference strategies designed for large-scale deep learning. It incorporates specialized mec

Qwen2.5-VL este un transformer multimodal autoregresiv conceput pentru a procesa secvențe intercalate de token-uri de text și vizuale. Acesta integrează embedding-urile caracteristicilor vizuale într-un spațiu comun de model de limbaj pentru a efectua raționamente cross-modale și a genera răspunsuri coerente sau cod de layout structurat. Proiectul se distinge prin maparea viziune-limbaj-acțiune, permițându-i să perceapă interfețele vizuale și să traducă acea percepție în comenzi acționabile pentru operarea ecranelor digitale și a hardware-ului robotic. Utilizează codificarea imaginilor cu rezoluție dinamică și indexarea video pe cadre temporale pentru a gestiona dimensiuni diverse ale imaginilor și secvențe vizuale de lungă durată. Modelul acoperă o suprafață largă de capabilități, inclusiv recunoașterea optică a caracterelor multilingve pentru digitizarea documentelor, ancorarea spațială pentru localizarea obiectelor prin bounding boxes și analiza conținutului video de lungă durată. De asemenea, suportă raționamentul matematic multimodal pentru a rezolva probleme folosind grafice și diagrame și își extinde înțelegerea la o lungime de context de un milion de token-uri.

Qwen2-VL is a multimodal large language model and vision language model designed to process and reason across text, images, and video content. It functions as a visual reasoning engine and a visual agent framework, capable of interpreting visual data to perform object detection, document parsing, and spatial reasoning. The model is distinguished by its ability to act as a video understanding model, processing hour-long videos with second-level indexing and event recall. It further differentiates itself through a visual agent capability that interacts with software interfaces and robotic hardw

Qwen3-VL is a multimodal vision-language model designed to process and reason across images, videos, and text. It functions as a computer vision framework capable of identifying objects, extracting structured data from documents, and interpreting spatial elements within visual media. The system operates as an automated user interface interaction agent, interpreting screen data to navigate software and mobile applications. By utilizing a unified transformer architecture, it performs complex visual reasoning to execute user-defined tasks without manual input. Beyond interface navigation, the m

Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t

Zerox is a multimodal document parser and OCR tool that uses vision models to convert PDF files and images into structured Markdown text. It functions as a visual layout extraction engine, leveraging large multimodal models to digitize documents while maintaining their original structural formatting. The system differentiates itself through the use of coordinate-based element mapping and multimodal layout analysis to identify structural elements like tables, charts, and headers. It utilizes rasterization to convert vector PDF pages into high-resolution bitmaps, ensuring consistent input for t

A fast, helpful, and open-source document parser

PyMuPDF is a comprehensive PDF manipulation library and document analysis tool. It serves as a text extraction tool, OCR engine, and image converter, providing a programmatic interface to edit, merge, split, and optimize PDF and Office documents. The project distinguishes itself through high-performance capabilities, including the use of C-bindings for low-level manipulation and parallelized page processing to accelerate workloads. It provides specialized conversion paths, such as transforming PDF content into Markdown for retrieval-augmented generation and large language model pipelines. It

Dolphin is a multimodal layout analyzer and image-to-structure converter that transforms photographed or digital document images into machine-readable structured data. It functions as an LLM document parser, utilizing vision-language models to simultaneously predict spatial layout and text content. The system is designed as a concurrent document processor, employing parallel document parsing to process multiple elements across distributed compute nodes. This high-throughput approach reduces the total time required to convert large volumes of images into structured formats. The project covers

Kreuzberg is a document extraction engine that converts PDFs, Office files, images, and over 90 other formats into clean, structured text and metadata. It is built around a compiled Rust core that can be used as a native library, a command-line tool, a REST API server, or a WebAssembly module for browser-based processing. The system is designed to run entirely on self-hosted infrastructure, with no data leaving the user's environment. What distinguishes Kreuzberg is its breadth of integration surfaces and its pipeline architecture. It exposes extraction capabilities through native bindings fo

DocTR is a deep learning OCR library built on PyTorch that detects and transcribes text in document images using a two-stage detection-recognition pipeline. It provides a complete framework for building and deploying OCR pipelines with pretrained models available through the Hugging Face Hub, and supports exporting trained models to ONNX format for cross-runtime deployment. The library offers end-to-end OCR pipelines that combine text detection and recognition to extract all text from document images or PDFs, with support for rotated page handling and varied text orientations. It includes cap

Layout-parser este un framework de deep learning pentru parsarea layout-ului documentelor și analiza imaginilor. Oferă un toolkit pentru extragerea informațiilor structurale și a modelelor de layout din documente scanate și imagini digitale, transformându-le în structuri de date programatice pentru analiză automatizată. Framework-ul integrează detectarea layout-ului cu recunoașterea optică a caracterelor (OCR) pentru a converti regiunile tabelare în date lizibile de către mașină. Utilizează rețele neuronale pentru a identifica și clasifica elementele structurale din imaginile documentelor fără a se baza pe sisteme manuale bazate pe reguli. Sistemul acoperă o gamă largă de capabilități de analiză a documentelor, inclusiv parsarea structurii documentului, extragerea automată a tabelelor și reprezentarea ierarhică a layout-ului. Include, de asemenea, instrumente de vizualizare pentru a randa elementele și ierarhiile detectate peste imaginile originale pentru verificarea rezultatelor.

Sparrow este o platformă LLM pentru extracția documentelor și un motor de inferență bazat pe viziune, conceput pentru a converti imagini și PDF-uri în date structurate validate. Funcționează ca un orchestrator de fluxuri de lucru agentice care înlănțuie sarcini de clasificare, extracție și validare în pipeline-uri multi-etapă. Sistemul se distinge printr-un strat de inferență agnostic față de backend, care gestionează modele pe GPU-uri locale, Apple Silicon și furnizori cloud. Utilizează grounding vizual bazat pe coordonate pentru a mapa textul extras la coordonate precise de tip bounding box și folosește direcționarea modelelor bazată pe indicii pentru a ghida atenția și a normaliza formatele de date. Platforma acoperă fluxuri de lucru de inteligență documentară, inclusiv procesarea specializată a tabelelor bazată pe imagini pentru a menține integritatea structurală și validarea bazată pe schemă pentru a verifica corectitudinea câmpurilor extrase. Oferă, de asemenea, un dashboard de analiză a documentelor pentru monitorizarea performanței API-ului, a analizei de utilizare și a stării sistemului. Arhitectura include un sistem de extensie bazat pe plugin-uri pentru integrarea bibliotecilor terțe utilizate în indexare și orchestrare.

sChandra is a document processing platform that converts images, PDFs, Word documents, spreadsheets, and other formats into structured output such as HTML, Markdown, or JSON while preserving layout. It can also extract specific data fields from invoices, contracts, or reports using user-defined JSON schemas, with citations back to source locations. The service supports form filling in PDF and image documents, document generation from Markdown, and extraction of tracked changes from Word files. The platform distinguishes itself with pipeline-based processing chains that combine multiple proces