Awesome GitHub RepositoriesSchema-Driven Extraction

Crawl4AI is an AI-powered web crawling and data extraction engine designed to transform complex web content into structured formats. It functions as a headless browser orchestrator, enabling the navigation of dynamic websites, the execution of custom scripts, and the capture of visual assets like screenshots and PDFs. By integrating language models directly into the extraction workflow, the system converts raw HTML into clean, structured data or Markdown files optimized for downstream ingestion. The platform distinguishes itself through a distributed, self-hosted infrastructure that manages l

Maigret is an open-source intelligence framework designed for automated digital footprint discovery and identity investigation. It functions as a search engine that aggregates profile metadata by querying thousands of websites for specific usernames, mapping an individual's online presence across diverse platforms. The tool distinguishes itself through recursive discovery capabilities, which identify links within discovered profiles to expand the scope of an investigation automatically. It supports cross-platform identity correlation by mapping disparate accounts and pseudonymous personas, in

Parsr 是一个非结构化数据提取器和文档解析流水线，可将原始文件和图像转换为清洗后的机器可读格式。它充当文档布局分析器，以及使用大语言模型提取结构化数据和标签的流水线。 该系统包含一个文档解析可视化工具，提供了一个图形界面来上传文档并检查生成的结构化数据输出。 该项目涵盖了文档数字化工作流，包括用于检测标题、表格和列表的布局分析，以及通过清洗和丰富非结构化内容实现的自动化数据录入。

sChandra is a document processing platform that converts images, PDFs, Word documents, spreadsheets, and other formats into structured output such as HTML, Markdown, or JSON while preserving layout. It can also extract specific data fields from invoices, contracts, or reports using user-defined JSON schemas, with citations back to source locations. The service supports form filling in PDF and image documents, document generation from Markdown, and extraction of tracked changes from Word files. The platform distinguishes itself with pipeline-based processing chains that combine multiple proces

This project is an academic competition tracker and metrics repository that provides historical submission and acceptance rates for major artificial intelligence research conferences. It serves as a dataset of AI conference statistics to monitor research competition trends. The repository enables the tracking of conference acceptance rates to analyze historical data, evaluate publication competitiveness, and monitor year-over-year growth in submission volumes across machine learning venues. The project is implemented as a static site that uses markdown-based data storage and schema-driven pa

DeepKE is a knowledge extraction toolkit and framework designed to transform unstructured text into structured knowledge graphs. It provides a pipeline for identifying and classifying named entities, semantic relations, and events, converting raw datasets into structured triples. The project utilizes large language models as tool callers through a standardized context protocol to drive automated data extraction processes. It supports schema-driven extraction across multiple domains and bilingual text, employing joint entity and relation extraction to identify components in a single structured

UABE 是一个专门的工具集，用于提取、修改和转换存储在 Unity 引擎包文件中的资产。它作为一个资产包提取器和游戏模组工具，旨在更改 Unity 游戏中的 3D 网格、纹理和音频。 该项目包含一个资产格式转换器，将内部 Unity 数据转换为通用文件格式以供外部编辑。它还具有模组安装程序生成器，可从修改后的资产包文件中创建独立的安装包。 该软件提供了游戏资源提取和资产转换的功能，允许用户检索嵌入文件并将专有的内部资产转换为标准媒体类型。

This project is an MCP browser automation server that connects large language models to headless cloud browsers. It functions as an autonomous web workflow engine and an LLM web agent interface, enabling the translation of natural language instructions into browser actions and structured data retrieval. The system distinguishes itself through a managed headless browser cloud API that supports concurrent Chromium sessions with integrated stealth modes, CAPTCHA solving, and proxy traffic routing. It utilizes self-healing element selection to maintain automation resilience when page structures c

AnyCrawl is an AI-powered data extractor, automated web crawler, and headless browser orchestrator. It serves as a web content extraction API and a gateway that connects crawling and scraping tools to language models using a standardized API protocol. The project specializes in converting unstructured website content into structured JSON or markdown optimized for AI assistants. It utilizes language models and JSON schemas to pull specific information into validated formats and provides capabilities for AI page summarization and LLM-optimized content extraction. The system manages comprehensi

该项目是一个 Model Context Protocol 服务器，使人工智能助手能够直接与 Microsoft Excel 文件交互。它充当桥梁，允许外部系统通过标准化接口读取、写入和修改电子表格数据。通过支持直接文件操作和无头应用自动化，该服务器为程序化工作簿管理提供了全面的工具。 该服务器的独特之处在于将数据处理能力与可视化渲染流水线相结合。它可以生成特定电子表格区域的图像快照，并捕获活动应用程序界面的截图，为自动化任务和报告提供视觉上下文。这些功能允许用户在提取结构化数据的同时，保持可视化和记录复杂工作簿状态的能力。 除了基本的数据操作，该工具还支持广泛的工作簿重构和格式化工作流。它支持工作表的创建、复制和组织，以及单元格样式和数字格式的程序化应用。为了确保大规模操作期间的稳定性，系统实现了基于分页的数据流传输，优化了处理大型文件时的内存使用和数据传输。