How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
An Extensible Image Crawler
The main features of vinta/haul are: Content Extraction.
Projects with overlapping indexed features include: executeautomation/mcp-playwright — This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for… alir3z4/python-sanitize — Bringing sanity to world of messed-up data. buriy/python-readability — fast python port of arc90's readability tool, updated to match latest readability.js! codelucas/newspaper — Newspaper is a Python library designed for scraping, parsing, and analyzing web-based information. It functions as a… coleifer/micawber — a small library for extracting rich content from urls. deanmalmgren/textract — Textract is a multi-format text extraction tool and parser. It provides a unified interface to extract plain text from…
This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for web automation, scraping, and end-to-end testing. It functions as a programmable interface for executing JavaScript, capturing screenshots, and interacting with web elements across multiple browser engines. The server exposes browser automation capabilities as a set of standardized tools that models can discover and invoke. It supports session-based browser isolation to ensure unique contexts for each client connection and provides a transport layer using either standard input
fast python port of arc90's readability tool, updated to match latest readability.js!
Newspaper is a Python library designed for scraping, parsing, and analyzing web-based information. It functions as a framework for automated news aggregation and large-scale web content extraction, providing tools to download, clean, and structure text, metadata, and media from diverse online sources. The project distinguishes itself through a pipeline-oriented architecture that combines heuristic-based content extraction with natural language processing. It automatically identifies and isolates article bodies from web page boilerplate while simultaneously performing language detection, keywo
