How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Dolphin is a multimodal layout analyzer and image-to-structure converter that transforms photographed or digital document images into machine-readable structured data. It functions as an LLM document parser, utilizing vision-language models to simultaneously predict spatial layout and text content.
The main features of bytedance/dolphin are: Vision-Language Inference, Document Layout Analyzers, Pixel Coordinate Mappings, Image-to-Text Transformers, Content Parsing Prompts, Document Image Transformations, Document Layout Analysis, Structured Document Extraction.
Projects with overlapping indexed features include: microsoft/unilm — This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based… katanaml/sparrow — Sparrow is an LLM document extraction platform and vision-based inference engine designed to convert images and PDFs… opendatalab/pdf-extract-kit — PDF-Extract-Kit is a document extraction toolkit designed to convert PDF documents into structured formats such as… getomni-ai/zerox — Zerox is a multimodal document parser and OCR tool that uses vision models to convert PDF files and images into… opendatalab/mineru — MinerU is a document parsing pipeline designed to transform unstructured files into machine-readable, structured data.… quivrhq/megaparse — Megaparse is a document parsing tool and RAG data preprocessor designed to convert PDFs, Word documents, and…
This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based models across multimodal, document intelligence, and natural language processing tasks. It provides a unified neural architecture that processes text, vision, audio, and document layout data through a shared set of weights, enabling researchers and developers to build foundational models that align cross-modal representations. The platform distinguishes itself through advanced training and inference strategies designed for large-scale deep learning. It incorporates specialized mec
Sparrow is an LLM document extraction platform and vision-based inference engine designed to convert images and PDFs into validated structured data. It functions as an agentic workflow orchestrator that chains classification, extraction, and validation tasks into multi-step pipelines. The system distinguishes itself through a backend-agnostic inference layer that manages models across local GPUs, Apple Silicon, and cloud providers. It employs coordinate-based visual grounding to map extracted text to precise bounding box coordinates and utilizes hint-based model steering to guide attention an
PDF-Extract-Kit is a document extraction toolkit designed to convert PDF documents into structured formats such as Markdown, HTML, and LaTeX. It functions as a multi-stage parsing framework that combines a document layout analyzer, a formula recognition engine, an OCR text extractor, and a table extraction system. The project focuses on recovering complex document elements by translating images of mathematical formulas and tabular structures into editable source code. It utilizes model-driven layout analysis to identify structural elements in reports and textbooks while ignoring noise like wa
Zerox is a multimodal document parser and OCR tool that uses vision models to convert PDF files and images into structured Markdown text. It functions as a visual layout extraction engine, leveraging large multimodal models to digitize documents while maintaining their original structural formatting. The system differentiates itself through the use of coordinate-based element mapping and multimodal layout analysis to identify structural elements like tables, charts, and headers. It utilizes rasterization to convert vector PDF pages into high-resolution bitmaps, ensuring consistent input for t