Awesome GitHub RepositoriesPDF Processing Engines

Stirling-PDF is a web-based PDF management suite used for editing, merging, splitting, and converting PDF documents. It functions as a self-hosted document manager, providing a centralized interface for users to manipulate files on a private server. The system features a workflow automation engine that allows for the creation of processing pipelines to handle large volumes of documents without writing custom code. It also includes an optical character recognition tool to convert scanned PDFs into searchable and editable text. Access is managed through single sign-on integration and OIDC comp

Stirling-PDF is a self-hosted document processing suite designed for secure, private file management. It functions as a comprehensive transformation engine that executes complex operations—such as merging, splitting, converting, and redacting documents—directly on the host machine. The platform provides both a browser-based interface for interactive editing and a programmatic, API-first architecture that allows for the automation of document workflows through standard HTTP requests. The project distinguishes itself through its focus on private, infrastructure-agnostic deployment and granular

Marker is an LLM-powered document parser and OCR pipeline designed to convert PDFs and unstructured files into structured markdown, JSON, and HTML. It functions as a data preprocessor that transforms complex documents into machine-readable formats while preserving tables, equations, and layout structures. The system utilizes large language models to refine OCR accuracy, clean mathematical notation, and merge fragmented tables across multiple pages. It employs model-based layout analysis to predict block types and bounding boxes, ensuring a more precise conversion of document elements. Capabi

This project is a framework for building custom AI chatbots capable of PDF document analysis. It implements Retrieval Augmented Generation to connect a large language model to private document data. The system utilizes graph-based agent orchestration to control conversation flow and decision logic. It maintains context across interactions through thread-based state management and delivers AI responses to the user interface via real-time streaming. The project covers PDF document ingestion through chunk-based processing and vector-store retrieval. It includes mechanisms for query-based data r

Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t

llm-universe is a structured learning resource and technical guide focused on the development of large language model applications. It serves as a curriculum for mastering model orchestration, the creation of autonomous conversational agents, and the implementation of retrieval-augmented generation systems. The project provides detailed instructions on connecting model APIs with memory and tools to create execution chains. It specifically covers the construction of retrieval pipelines, including the process of cleaning raw documents, generating embeddings, and integrating vector databases to

Gotenberg is a stateless, containerized service that provides a unified API for document conversion, manipulation, and web-to-PDF rendering. It functions as a centralized engine that abstracts complex document processing tasks, allowing users to interact with various rendering tools and libraries through standard HTTP requests. The service distinguishes itself by utilizing headless browser automation to capture web content and by wrapping multiple specialized PDF engines into a single interface. It supports asynchronous task execution, offloading resource-intensive operations to background wo

PyMuPDF is a comprehensive PDF manipulation library and document analysis tool. It serves as a text extraction tool, OCR engine, and image converter, providing a programmatic interface to edit, merge, split, and optimize PDF and Office documents. The project distinguishes itself through high-performance capabilities, including the use of C-bindings for low-level manipulation and parallelized page processing to accelerate workloads. It provides specialized conversion paths, such as transforming PDF content into Markdown for retrieval-augmented generation and large language model pipelines. It

Remark is a markdown processor that parses markdown text into a structured JSON abstract syntax tree for programmatic analysis and transformation. It functions as a markdown AST parser and processor, utilizing a plugin framework to manage extensible syntax and transformation rules. The project enables custom markdown syntax extensions and content transformation through a plugin system, allowing for the addition of non-standard markup and metadata. It also includes a markdown linter to identify style inconsistencies and ensure adherence to writing standards. The toolset covers markdown docume

Dolphin is a multimodal layout analyzer and image-to-structure converter that transforms photographed or digital document images into machine-readable structured data. It functions as an LLM document parser, utilizing vision-language models to simultaneously predict spatial layout and text content. The system is designed as a concurrent document processor, employing parallel document parsing to process multiple elements across distributed compute nodes. This high-throughput approach reduces the total time required to convert large volumes of images into structured formats. The project covers

Kreuzberg is a document extraction engine that converts PDFs, Office files, images, and over 90 other formats into clean, structured text and metadata. It is built around a compiled Rust core that can be used as a native library, a command-line tool, a REST API server, or a WebAssembly module for browser-based processing. The system is designed to run entirely on self-hosted infrastructure, with no data leaving the user's environment. What distinguishes Kreuzberg is its breadth of integration surfaces and its pipeline architecture. It exposes extraction capabilities through native bindings fo

Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it

Elvish is a shell that combines interactive command-line use with a structured scripting language, designed to make both everyday terminal work and automation tasks more predictable and readable. It parses, compiles, and executes code in three phases, catching syntax and variable errors before any code runs, and it aborts execution on command failure by default to prevent silent errors. The shell introduces value-oriented pipelines that pass structured data like lists, maps, and closures between commands, preserving types without serialization. It also mixes traditional byte streams with thes

Sparrow هي منصة لاستخراج البيانات من المستندات تعتمد على النماذج اللغوية الكبيرة (LLM) ومحرك استنتاج بصري مصمم لتحويل الصور وملفات PDF إلى بيانات مهيكلة وموثقة. تعمل كمنسق لسير عمل الوكلاء (agentic workflow) الذي يربط مهام التصنيف والاستخراج والتحقق في خطوط معالجة متعددة الخطوات. يتميز النظام بطبقة استنتاج مستقلة عن الخلفية (backend-agnostic) تدير النماذج عبر وحدات معالجة الرسوميات المحلية، وApple Silicon، ومزودي الخدمات السحابية. يستخدم النظام التحديد البصري القائم على الإحداثيات لربط النص المستخرج بإحداثيات دقيقة، ويستخدم توجيه النماذج القائم على التلميحات لتوجيه الانتباه وتوحيد تنسيقات البيانات. تغطي المنصة سير عمل ذكاء المستندات، بما في ذلك معالجة الجداول القائمة على الصور للحفاظ على السلامة الهيكلية، والتحقق القائم على المخططات لضمان صحة الحقول المستخرجة. كما توفر لوحة تحكم لتحليل المستندات لمراقبة أداء واجهة برمجة التطبيقات (API) وتحليلات الاستخدام وصحة النظام. تتضمن البنية نظام إضافات (plugin-based) لدمج مكتبات الطرف الثالث المستخدمة في الفهرسة والتنسيق.

sChandra is a document processing platform that converts images, PDFs, Word documents, spreadsheets, and other formats into structured output such as HTML, Markdown, or JSON while preserving layout. It can also extract specific data fields from invoices, contracts, or reports using user-defined JSON schemas, with citations back to source locations. The service supports form filling in PDF and image documents, document generation from Markdown, and extraction of tracked changes from Word files. The platform distinguishes itself with pipeline-based processing chains that combine multiple proces

PDF-Guru هو معالج مستندات مدعوم بالذكاء الاصطناعي ومحول مواد دراسية مصمم لتحويل الكتب المدرسية والأوراق البحثية والمحتوى متعدد الوسائط إلى بطاقات تعليمية منظمة لأنظمة التكرار المتباعد مثل Anki. يعمل كخط أنابيب محتوى يستخدم نماذج لغوية لاستخراج المفاهيم والحقائق الرئيسية من المستندات غير المنظمة لتوليد أزواج الأسئلة والأجوبة، وحذف الكلمات (cloze deletions)، وبطاقات الاختيار من متعدد. يتميز النظام بمجموعة شاملة لإدارة PDF وتحليل التنسيقات المتعددة. يوفر أدوات مستندات متقدمة بما في ذلك التعرف الضوئي على الحروف (OCR) لإنشاء ملفات PDF قابلة للبحث، والتعليق التوضيحي المجمع، ومعالجة الصفحات منخفضة المستوى مثل الدمج والتقسيم والقص والتدوير. كما يدعم تحويل المدخلات المتنوعة، بما في ذلك جداول البيانات، والخرائط الذهنية، والكتب الإلكترونية، ومقاطع الفيديو—كاملة مع لقطات إطارات مؤرخة—إلى أصول دراسية. بعيداً عن توليد المحتوى، يتضمن المشروع أدوات لإدارة البطاقات والمجموعات، مثل التحرير المجمع للحقول وتكوين القوالب. ويدعم مزامنة البيانات عبر الأجهزة عبر الشبكات المحلية، أو الخوادم البعيدة، أو الخلفيات ذاتية الاستضافة، ويتكامل مع مكتبات Zotero البحثية. كما تتعامل المنصة مع تحسين الأصول عن طريق استبدال الصور المضمنة بروابط سحابية لتقليل وقت التخزين والمزامنة. يمكن للمستخدمين تصدير ملاحظات القراءة ومجموعات البطاقات الخاصة بهم إلى تنسيقات متعددة، بما في ذلك Markdown وTXT وXLSX وPDF.

pdf2docx is a suite of PDF utilities designed to transform static PDF documents into editable DOCX files. It functions as a multi-core processor capable of accelerating the conversion of large files by distributing page tasks across multiple CPU cores. The project includes specialized tools for decrypting password-protected PDF files and extracting tabular content as structured data. It also provides a layout analyzer to visually inspect and verify document structure during the conversion process. Conversion is accessible through both a graphical user interface and a command-line interface,

Embed PDF Viewer is a browser-based PDF rendering library that uses a WebAssembly port of the PDFium engine to display documents entirely on the client side, with no server-side processing required. It provides a framework-agnostic core engine layer that manages the PDF document lifecycle, memory allocation, and WebAssembly resource cleanup, with dedicated integration hooks for React and Vue 3 that handle initialization, document loading, and reactive state management. The library offers both a pre-built, embeddable viewer that can be inserted into any web page with a single initialization ca

Pdfcraft is a containerized service for self-managed PDF processing, editing, and conversion. It provides a toolkit for document manipulation, a multi-format converter, and OCR software to transform scanned documents into searchable and editable text. The project features a visual, node-based workflow editor that allows users to build automated pipelines by chaining together various PDF conversion and optimization operations. The service covers a broad range of capabilities, including document management for merging and splitting files, format conversion between PDFs and office documents or