How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
Scylla is a system for managing HTTP proxy pools and automating web extraction. It provides a specialized data acquisition pipeline designed for gathering large-scale internet datasets for training and fine-tuning large language models. The project features a proxy rotation gateway that assigns fresh proxy addresses to incoming requests to mask origin traffic and avoid IP blocking. It includes a proxy pool manager that handles the collection, functional validation, and orchestration of proxy servers, complemented by a web dashboard for monitoring the health and geographic distribution of the
This project is a public proxy aggregator and directory providing curated lists of validated HTTP and SOCKS proxy servers. It features a machine-readable API service and tools designed for anonymous network routing and the automated rotation of outgoing IP addresses. The system distinguishes itself through a proxy rotation tool used to bypass rate limits and prevent detection by automated security systems. It provides a programmatic interface for retrieving and filtering verified proxies by country and protocol, delivering this data in JSON and text formats for integration into custom applica
ProxyPool is a proxy pool manager that automatically collects, validates, and serves HTTP proxies from multiple sources through a web API. At its core, it runs scheduled background processes that scrape free and paid proxy websites, test each proxy's availability against configurable target URLs using asynchronous HTTP clients, and store the results in a Redis-backed sorted set where proxies are scored and ranked by reliability. The system distinguishes itself through a pluggable crawler architecture that allows users to add new proxy sources by writing a simple class with target URLs and a p
This project is a Python-based proxy pool manager that collects, validates, and serves free proxy IP addresses through an HTTP API. It consists of an automated scraper to gather addresses from multiple online sources, a persistent database-backed store for organization, and a delivery interface for retrieving validated proxies. The system features a pluggable scraper architecture that allows for the integration of custom discovery methods and source expansion via generator functions. It employs decorator-based validation logic, enabling the definition of custom connectivity and HTTPS criteria
PROXY-List is a public proxy aggregator that provides data structures for storing and aggregating publicly available HTTP and SOCKS proxy server addresses. It serves as a source for retrieving network traffic routing lists used to mask origin IP addresses during web requests.
The main features of thespeedx/proxy-list are: Public Proxy Lists, IP Address Masking, Network Traffic Proxying, Proxy Pool Automation, Proxy Sourcing Directories, Proxy Source Aggregators, Scraping Infrastructure Management, Web Scraping.
Open-source alternatives to thespeedx/proxy-list include: mikechongcan/scylla — Scylla is a system for managing HTTP proxy pools and automating web extraction. It provides a specialized data… proxifly/free-proxy-list — This project is a public proxy aggregator and directory providing curated lists of validated HTTP and SOCKS proxy… python3webspider/proxypool — ProxyPool is a proxy pool manager that automatically collects, validates, and serves HTTP proxies from multiple… jhao104/proxy_pool — This project is a Python-based proxy pool manager that collects, validates, and serves free proxy IP addresses through… bepass-org/oblivion — Oblivion is an encrypted tunneling service and internet privacy tool designed to route network traffic through private… jack-cherish/python-spider — This is a collection of Python scripts designed for extracting data from popular Chinese websites and mobile…