For LLM इनजेशन पाइपलाइन्स के लिए डॉक्यूमेंट पार्सर, the strongest matches are vikparuchuri/marker (Marker is an LLM-powered PDF parser and OCR pipeline), katanaml/sparrow (Sparrow is a dedicated LLM-powered document extraction platform that) and opendatalab/pdf-extract-kit (PDF-Extract-Kit is a multi-stage parsing toolkit that extracts text). pymupdf/pymupdf and breezedeus/pix2text round out the shortlist. Each is ranked by relevance to your query, popularity and recent activity.
LLM में सीमलेस इंटीग्रेशन के लिए PDF डॉक्यूमेंट्स से स्ट्रक्चर्ड डेटा और टेक्स्ट एक्सट्रैक्ट करने वाले टूल्स।
Marker is an LLM-powered document parser and OCR pipeline designed to convert PDFs and unstructured files into structured markdown, JSON, and HTML. It functions as a data preprocessor that transforms complex documents into machine-readable formats while preserving tables, equations, and layout structures. The system utilizes large language models to refine OCR accuracy, clean mathematical notation, and merge fragmented tables across multiple pages. It employs model-based layout analysis to predict block types and bounding boxes, ensuring a more precise conversion of document elements. Capabi
Marker is an LLM-powered PDF parser and OCR pipeline that extracts text and tables into structured markdown or JSON, preserving layout and chunking documents for LLM ingestion — exactly what this search is after.
Sparrow is an LLM document extraction platform and vision-based inference engine designed to convert images and PDFs into validated structured data. It functions as an agentic workflow orchestrator that chains classification, extraction, and validation tasks into multi-step pipelines. The system distinguishes itself through a backend-agnostic inference layer that manages models across local GPUs, Apple Silicon, and cloud providers. It employs coordinate-based visual grounding to map extracted text to precise bounding box coordinates and utilizes hint-based model steering to guide attention an
Sparrow is a dedicated LLM-powered document extraction platform that extracts text and tables from PDFs and images and outputs validated structured data, providing exactly the pipeline-ready format needed for LLM ingestion with vision-based OCR and structure preservation.
PDF-Extract-Kit is a document extraction toolkit designed to convert PDF documents into structured formats such as Markdown, HTML, and LaTeX. It functions as a multi-stage parsing framework that combines a document layout analyzer, a formula recognition engine, an OCR text extractor, and a table extraction system. The project focuses on recovering complex document elements by translating images of mathematical formulas and tabular structures into editable source code. It utilizes model-driven layout analysis to identify structural elements in reports and textbooks while ignoring noise like wa
PDF-Extract-Kit is a multi-stage parsing toolkit that extracts text, tables, and formulas from PDFs using OCR and layout analysis, outputting structured Markdown/HTML that is directly suitable for LLM ingestion—covering nearly all the requested features.
PyMuPDF is a comprehensive PDF manipulation library and document analysis tool. It serves as a text extraction tool, OCR engine, and image converter, providing a programmatic interface to edit, merge, split, and optimize PDF and Office documents. The project distinguishes itself through high-performance capabilities, including the use of C-bindings for low-level manipulation and parallelized page processing to accelerate workloads. It provides specialized conversion paths, such as transforming PDF content into Markdown for retrieval-augmented generation and large language model pipelines. It
PyMuPDF is a Python library that extracts text and tables from PDFs, supports OCR via Tesseract, and can output Markdown specifically for RAG and LLM pipelines, directly matching your need for PDF and table extraction with LLM-ready formatting.
Pix2Text is an optical character recognition system and document conversion tool designed to transform images and PDFs into Markdown. It functions as a multilingual OCR engine supporting over 80 languages, a LaTeX formula recognizer for mathematical notations, and a parser integrated with vision language models. The project utilizes a hybrid pipeline to separate plain text from mathematical formulas and tabular structures within a single pass. It converts recognized formulas into LaTeX expressions and transforms detected tables and layouts into structured Markdown formatting. The system incl
Pix2Text extracts text, tables, and formulas from PDFs and images into structured Markdown using OCR and layout analysis, making it directly useful for preparing documents for LLM ingestion — you would just need to add your own chunking step.
This project is a PDF data extraction tool and document preprocessor designed to convert PDF files into structured formats such as Markdown, JSON, and HTML. It functions as an OCR document parser for scanned files, an accessibility automator for generating PDF/UA compliant metadata, and a loader for AI orchestration frameworks like LangChain. The software distinguishes itself through specialized handling of complex document elements, including the conversion of mathematical formulas into LaTeX and the generation of natural-language descriptions for charts and images. It utilizes recursive seg
This tool extracts text and tables from PDFs (including scanned ones via OCR), produces LLM-ready Markdown/JSON/HTML, preserves document structure, and chunks content for context windows—directly matching every feature of your PDF-to-LLM pipeline.
Kreuzberg is a document extraction engine that converts PDFs, Office files, images, and over 90 other formats into clean, structured text and metadata. It is built around a compiled Rust core that can be used as a native library, a command-line tool, a REST API server, or a WebAssembly module for browser-based processing. The system is designed to run entirely on self-hosted infrastructure, with no data leaving the user's environment. What distinguishes Kreuzberg is its breadth of integration surfaces and its pipeline architecture. It exposes extraction capabilities through native bindings fo
Kreuzberg is a dedicated document extraction engine that excels at PDF and table extraction with OCR via Tesseract, outputs clean structured text and metadata ready for LLM ingestion, and its pipeline architecture supports RAG workflows—matching every required feature for preparing PDFs for LLM pipelines.
Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t
Unstructured is a full document-processing engine that extracts text and tables from PDFs using rule-based and vision-based methods, then partitions the output into structured chunks ready for RAG and LLM ingestion — covering every feature this search asks for.
MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data. It utilizes deep learning models to perform layout analysis, identifying document regions and extracting complex content such as mathematical expressions. By combining these neural network inferences with geometric heuristics, the system reconstructs the reading order and structural hierarchy of documents to ensure accurate data representation. The project distinguishes itself through a multi-stage processing workflow that integrates layout detection, optical character recogn
MinerU is a document parsing pipeline with deep-learning-based layout analysis, OCR, and structure reconstruction that transforms unstructured PDFs into structured data ready for LLM ingestion, directly matching all core requirements including text and table extraction.
Zerox is a multimodal document parser and OCR tool that uses vision models to convert PDF files and images into structured Markdown text. It functions as a visual layout extraction engine, leveraging large multimodal models to digitize documents while maintaining their original structural formatting. The system differentiates itself through the use of coordinate-based element mapping and multimodal layout analysis to identify structural elements like tables, charts, and headers. It utilizes rasterization to convert vector PDF pages into high-resolution bitmaps, ensuring consistent input for t
Zerox extracts text, tables, and layout from PDFs using vision models and outputs structured Markdown, making it a direct fit for LLM ingestion pipelines with OCR and structure preservation, though it does not explicitly mention chunking for context windows.
Docling is a modular framework designed for document parsing, layout analysis, and structured data extraction. It transforms unstructured files and web content into a unified, hierarchical data model that preserves the spatial and semantic relationships between text, tables, images, and layout elements. By normalizing diverse input formats into a consistent internal representation, the library enables uniform processing across various document types. The project distinguishes itself through a schema-driven approach that maps document regions to strongly-typed objects, ensuring data accuracy t
Docling is a modular framework that parses PDFs and other documents into a structured hierarchical model that preserves text, tables, and layout, making it suitable for preparing data for LLM ingestion — it directly addresses the core need, though explicit OCR and chunking features are not confirmed in the description.
Layout-parser is a deep learning document layout parser and image analysis framework. It provides a toolkit for extracting structural information and layout patterns from scanned documents and digital images, transforming them into programmatic data structures for automated analysis. The framework integrates layout detection with optical character recognition to convert tabular regions into machine-readable data. It utilizes neural networks to identify and classify structural elements within document images without relying on manual rule-based systems. The system covers a broad range of docu
layout-parser extracts text and tables from document images (including scanned PDFs) via deep learning and OCR, outputting structured data suitable for LLM pipelines, though it lacks built-in chunking and explicit LLM-ready formatting.
This project is an AI-powered document processing engine designed to transform diverse file formats into structured Markdown. By leveraging multimodal language models, it performs complex layout analysis and semantic text extraction, allowing for the conversion of both unstructured files and scanned images into machine-readable content. The toolkit distinguishes itself through a modular, plugin-based architecture that orchestrates multi-stage extraction pipelines. Users can steer the parsing behavior by injecting custom instructions, enabling the system to adapt to domain-specific document st
Markitdown is an AI-powered document processing engine that converts PDFs and scanned images into structured Markdown using layout analysis and OCR, making it directly suited for preparing LLM-ready text; however, explicit table extraction and built-in chunking are not highlighted in its description.
pdf-craft is an OCR-based document parser and structure extractor designed to convert PDF files into structured data, Markdown, or EPUB ebooks. It utilizes optical character recognition and statistical analysis to identify document hierarchies and extract text and structured content. The system features specialized rendering for mathematical formulas and tables, using heuristic reconstruction to convert tabular data into digital formats. It includes a document structure extractor that builds tables of contents by analyzing font sizes, linguistic patterns, and language model title detection.
pdf-craft is an OCR-based PDF parser and structure extractor that outputs to structured data, Markdown, or EPUB with table and formula reconstruction, making it well suited for LLM ingestion; it covers text extraction, OCR, table extraction, and document structure, though it lacks explicit chunking for context windows.
| रिपॉजिटरी | स्टार्स | भाषा | लाइसेंस | अंतिम पुश |
|---|---|---|---|---|
| vikparuchuri/marker | 36.2K | Python | GPL-3.0 | |
| katanaml/sparrow | 5.2K | Python | GPL-3.0 | |
| opendatalab/pdf-extract-kit | 9.7K | Python | AGPL-3.0 | |
| pymupdf/pymupdf | 9.1K | Python | agpl-3.0 | |
| breezedeus/pix2text | 3K | Jupyter Notebook | mit | |
| opendataloader-project/opendataloader-pdf | 25.8K | Java | Apache-2.0 | |
| kreuzberg-dev/kreuzberg | 8.5K | Rust | NOASSERTION | |
| unstructured-io/unstructured | 14K | HTML | apache-2.0 | |
| opendatalab/mineru | 67.7K | Python | NOASSERTION | |
| getomni-ai/zerox | 12.2K | TypeScript | MIT |