How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
so-novel is a web novel downloader and scraping engine designed to extract structured text from websites and convert it into electronic book formats. It functions as a multi-interface content extractor, providing a shared backend accessible via a web-based management dashboard, a terminal user interface, and a command line interface. The system utilizes a rule-driven approach for data extraction, using CSS selectors and XPath rules defined in external configuration files to map web elements to specific data fields. To maintain access to content, it includes a proxy-routed request pipeline to
Requests is a Python HTTP client library used for sending HTTP requests and handling responses. It serves as a network client providing fundamental components for session management, proxy routing, multi-part uploading, and SSL/TLS certificate verification. The project distinguishes itself through a session manager that maintains cookies and reuses TCP connections to improve network performance. It also includes a dedicated multi-part form uploader for transmitting binary data and an integrated SSL/TLS certificate verifier to ensure encrypted and trusted communication. The library covers a b
This project is a V2Ray configuration repository that provides a collection of pre-configured server settings and connection strings. It serves as a curated set of remote proxy addresses and security metadata used to establish encrypted network tunnels for routing internet traffic. The project focuses on the distribution of Base64-encoded configuration strings, which allow for the retrieval and deployment of server settings to establish secure connections. It includes tools for latency benchmarking, measuring response times and pinging configuration links to filter and rank the most performan
Goutte is a PHP web scraper and DOM crawler designed for extracting data from websites. It functions as an HTTP client wrapper that enables the retrieval of web pages and the parsing of HTML content. The project provides a web form automator to programmatically fill and submit HTML forms to remote servers. It also includes a mechanism for automated website crawling by following links to discover and archive web content. The system supports stateful session management to maintain cookies and headers across requests. It further covers HTML data extraction through DOM-based element selection an
This project is a distributed scraping engine designed to extract business details, customer reviews, and lead information from Google Maps. It functions as a business scraper and data extractor that can be deployed as a permanent system or as on-demand serverless functions.
The main features of gosom/google-maps-scraper are: Maps Data Extraction, Business Scrapers, Lead Extraction, Email Address Extraction, Distributed Task Coordination, Task Distribution Scaling, Traffic Routing Proxies, Proxy Routing.
Projects with overlapping indexed features include: freeok/so-novel — so-novel is a web novel downloader and scraping engine designed to extract structured text from websites and convert… requests/requests — Requests is a Python HTTP client library used for sending HTTP requests and handling responses. It serves as a network… epodonios/v2ray-configs — This project is a V2Ray configuration repository that provides a collection of pre-configured server settings and… friendsofphp/goutte — Goutte is a PHP web scraper and DOM crawler designed for extracting data from websites. It functions as an HTTP client… ripmeapp/ripme — Ripme is a batch media downloader and web media scraper designed for extracting images and videos from image-hosting… shazow/urllib3 — urllib3 is a Python HTTP client library used to send network requests and receive responses. It provides core…