How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
a small library for extracting rich content from urls
Sumy is a text summarization library and toolset designed to identify and extract the most important sentences from plain text documents and HTML web pages. It functions as an extractive summarization system, meaning it selects representative original sentences from a source text without generating new words or modifying existing phrasing. The project provides a suite of algorithmic methods for content distillation, including frequency-based sentence scoring and graph-based text ranking. It also includes utilities for HTML-to-text sanitization to isolate primary content and heuristic filterin
This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for web automation, scraping, and end-to-end testing. It functions as a programmable interface for executing JavaScript, capturing screenshots, and interacting with web elements across multiple browser engines. The server exposes browser automation capabilities as a set of standardized tools that models can discover and invoke. It supports session-based browser isolation to ensure unique contexts for each client connection and provides a transport layer using either standard input
Autoscraper is an automatic web scraping library and pattern-based data extractor that learns extraction rules from sample data. It identifies and retrieves text, URLs, and HTML elements from web pages by analyzing sample values to replicate data patterns across different URLs. The system functions as a web scraping model manager, allowing users to save and reload learned rules to maintain consistent data extraction. It supports the export and import of scraping rules to a local file system to avoid repeating the training process for the same website. The library covers automated web data ex
Convert HTML to Markdown-formatted text.
The main features of alir3z4/html2text are: Content Extraction, Web Scraping.
Projects with overlapping indexed features include: coleifer/micawber — a small library for extracting rich content from urls. miso-belica/sumy — Sumy is a text summarization library and toolset designed to identify and extract the most important sentences from… executeautomation/mcp-playwright — This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for… alirezamika/autoscraper — Autoscraper is an automatic web scraping library and pattern-based data extractor that learns extraction rules from… binux/pyspider — PySpider is a Python web crawling framework designed for automated data extraction. It provides a pipeline for… bda-research/node-crawler — node-crawler is a programmable web crawler for Node.js that manages request queues and automates data extraction. It…