Open-source alternatives to IPProxyPool

Scylla is a system for managing HTTP proxy pools and automating web extraction. It provides a specialized data acquisition pipeline designed for gathering large-scale internet datasets for training and fine-tuning large language models. The project features a proxy rotation gateway that assigns fresh proxy addresses to incoming requests to mask origin traffic and avoid IP blocking. It includes a proxy pool manager that handles the collection, functional validation, and orchestration of proxy servers, complemented by a web dashboard for monitoring the health and geographic distribution of the

This project is a public proxy aggregator and directory providing curated lists of validated HTTP and SOCKS proxy servers. It features a machine-readable API service and tools designed for anonymous network routing and the automated rotation of outgoing IP addresses. The system distinguishes itself through a proxy rotation tool used to bypass rate limits and prevent detection by automated security systems. It provides a programmatic interface for retrieving and filtering verified proxies by country and protocol, delivering this data in JSON and text formats for integration into custom applica

This project is a proxy aggregation platform designed to collect and verify free proxy server lists from web platforms, social media, and public repositories. It functions as a crawler framework that gathers proxy data and subscription links, a validation tool for testing server liveness, and a synchronization service for distributing the results. The system uses a plugin-based architecture that allows for the integration of custom Python scripts to handle diverse web source structures. It also includes utilities to transform raw proxy data into standardized configuration formats compatible w

TscanPlus is an external attack surface management tool and security reconnaissance framework designed for discovering network assets, enumerating subdomains, and mapping internet-facing services. It functions as a vulnerability scanning framework and network asset discovery suite to identify security exposure and map active hosts. The platform distinguishes itself by integrating an intelligence layer that uses large language models to analyze raw scan results and identify security weaknesses within JavaScript code. It also includes a dedicated proxy management system that validates and rotat

Proxypool is an automated proxy crawler and aggregator that discovers, validates, and curates proxy servers from public pages and subscription addresses. It functions as a background service that collects proxy nodes across multiple protocols and serves the resulting validated list through a network API for external consumption. The system manages the full lifecycle of proxy discovery by aggregating data from multiple sources, deduplicating entries, and utilizing a connectivity validator to ensure only active and functional nodes are maintained. Crawl sources are managed via a configuration f

PROXY-List is a public proxy aggregator that provides data structures for storing and aggregating publicly available HTTP and SOCKS proxy server addresses. It serves as a source for retrieving network traffic routing lists used to mask origin IP addresses during web requests. The project utilizes a data pipeline to automatically scrape, poll, and serialize proxy lists from multiple public websites. This infrastructure ensures the availability of active servers through scheduled periodic polling and automated content refreshes, delivering the resulting lists as plain text files. These capabil

Robin is an AI-powered open source intelligence framework and dark web investigation tool. It functions as a multi-model AI orchestrator that integrates search engines and web scrapers with language models to automate information gathering and data synthesis. The system utilizes a crawl-and-filter architecture to isolate high-value data from raw web content and employs a query-refinement pipeline to optimize search terms. It specifically supports dark web investigations by routing requests through proxies to access hidden services and using language models to analyze and summarize findings fr

This project is a public community data API that provides a RESTful interface for accessing real-time discussions and metadata. It serves as a JSON data provider, offering structured community information for use in third-party client and server applications. The interface enables the retrieval of public items, stories, and comments, as well as public account information for specific users. It provides capabilities for fetching filtered lists of stories based on ranking or novelty and allows for the discovery of recent items to track new content updates. The system covers a broad range of da

Idurar is an integrated system combining Customer Relationship Management and Enterprise Resource Planning. It functions as a headless business API that generates secure REST endpoints and administrative panels from configuration files to connect business logic with external applications. The platform supports multi-tenant SaaS management, isolating data and configurations for multiple companies or branches within a single installation. It is designed for international business accounting, featuring a multi-currency financial engine that processes transactions and manages regional tax rules a

XWiki Platform is a collaborative content management system and enterprise wiki designed for creating, organizing, and sharing structured documentation. It functions as a Java-based application framework that enables teams to build data-driven business applications directly within a web environment. By combining a flexible knowledge base with modular development tools, the platform supports both standard document management and the creation of custom, interactive software solutions. The platform distinguishes itself through a highly extensible architecture that allows for deep customization w

Hyperion is an ambient lighting controller and screen color capture engine designed to synchronize networked LED hardware with real-time video and audio content. It functions as a programmable lighting effects engine and networked server, capturing frames from system displays or USB devices to extract dominant colors for immersive lighting environments. The system distinguishes itself through a protocol-agnostic hardware abstraction layer and a coordinate-based LED mapping system that uses keystone correction for precise physical alignment. It features a modular scripting engine for custom vi

Authorizer is an open-source identity provider that functions as a centralized authentication and authorization platform. It manages user identities and session lifecycles by implementing standard OpenID Connect protocols, allowing for secure verification across web, mobile, and backend applications. The service is designed as a containerized microservice that provides a unified interface for administrative and authentication operations. The platform distinguishes itself through a multi-tenant architecture that isolates authentication rules and user data across different business domains. It

Rivet is a distributed infrastructure for managing the lifecycle, addressing, and persistence of stateful actors and durable execution engines. It provides a distributed process sandbox that executes application logic within lightweight isolates, ensuring resource isolation and fast cold starts. The system is designed to coordinate multi-step operations using persistent queues and timers to guarantee reliable task completion across distributed environments. The platform specifically enables the orchestration of stateful AI agents that maintain persistent memory and state across long-running i

This project is a web-based manga and novel downloader and multi-site web scraper designed to extract images and text from diverse media platforms. It functions as a digital media archiver and EPUB e-book generator, using a plugin-based crawler architecture with site-specific scripts to define how content is extracted from various international websites. The system distinguishes itself through authenticated web crawling, using browser cookie simulation to access restricted or member-only content. It includes specialized capabilities for digital comic archiving, which organizes image sequences

This is a collection of Python scripts designed for extracting data from popular Chinese websites and mobile applications. It functions as a multi-platform data extraction toolkit, capable of automating tasks such as downloading videos from platforms like Bilibili and Douyin, scraping product reviews and images from e-commerce sites like Taobao and JD.com, and booking train tickets on the 12306 railway system. The project distinguishes itself through its focus on automating specific, high-value tasks within the Chinese internet ecosystem. It includes capabilities for solving Chinese CAPTCHA c

This project is a database abstraction layer for Laravel that implements the repository pattern to decouple business logic from Eloquent database queries. It provides a standardized interface for data retrieval, pagination, and filtering. The system includes a query criteria mechanism for applying reusable search conditions based on request parameters and a caching wrapper that automatically clears stored results during record creation, updates, or deletions. It also features a presentation layer to transform raw database model attributes into formatted output for user interfaces. Additional

Leon is a framework for building personal AI assistants that integrates large language models with local tool execution and persistent memory. It functions as an agentic workflow orchestrator and modular skill engine, enabling the creation of autonomous assistants capable of planning and executing multi-step tasks. The system features a retrieval-augmented generation memory architecture that indexes conversation history and user facts for context-aware grounding. It utilizes a modular skill system to interact with external binaries and APIs, supported by a loop that handles tool calling, sche

This project is a curated directory and catalog of privacy-respecting software and security-focused services. It serves as a structured resource for finding alternatives to corporate services, focusing on tools that prioritize data sovereignty, end-to-end encryption, and user anonymity. The directory is maintained as a markdown-based resource list and rendered via a static site generator. It further extends its utility through a CORS-enabled public API and a JSON-based data schema, allowing the curated catalog of tools and providers to be retrieved programmatically. The collection covers a w

Shadowrocket is a proxy client application for mobile devices that functions as a multi-protocol proxy manager and a rule-based traffic router. It acts as a programmable network gateway, utilizing a virtual network interface to route system-level traffic through secure tunnels. The project distinguishes itself through a programmable environment that executes JavaScript scripts and modules to automate DNS resolution and handle complex network request logic. It further provides an HTTPS traffic inspector capable of decrypting encrypted traffic using custom certificates to modify headers and rew

Pingora is a Rust-based framework for building high-performance network services, including HTTP reverse proxies, layer seven load balancers, and TLS termination proxies. It serves as an asynchronous network library designed to intercept and route HTTP, gRPC, and WebSocket traffic between clients and upstream backend servers. The project enables zero-downtime service updates by handing over listening sockets between processes during binary or configuration upgrades. It utilizes a programmable multi-phase pipeline to modify request and response bodies and headers, and it provides a pluggable T

Nacos is a service discovery and configuration platform designed for cloud native environments. It serves as a management plane that orchestrates service registries, handles dynamic application settings through a remote configuration store, and functions as a load balancing control plane for distributed clusters. The platform differentiates itself by providing real-time configuration updates that push changes to clients without requiring service restarts. It also implements weighted routing and DNS-based traffic routing to manage load balancing policies across a fleet of healthy service insta

Healthchecks is a heartbeat monitoring service and cron job monitoring tool designed to track the execution and success of scheduled tasks and systemd timers. It functions as a dead man switch, alerting users when expected periodic signals from remote processes fail to arrive. The system accepts health signals via HTTP and SMTP, allowing it to track infrastructure heartbeats from sources ranging from CI/CD workflows to network routers. It distinguishes itself by supporting the capture of diagnostic data, including exit codes and execution logs, and by calculating the duration between start an

LoopBack Next is a Node.js API framework used for building REST and multi-protocol APIs. It functions as an OpenAPI server implementation that can either generate machine-readable specifications from code or produce implementation controllers and models from existing specifications. The framework distinguishes itself through a central dependency injection container and a repository-pattern data access layer. This architecture decouples application logic from component construction and persistent storage, allowing for a pluggable system where data sources and business logic are isolated throug

Budibase is a low-code application platform and enterprise internal tool builder used to create custom business applications for organizational processes and reporting. It functions as a self-hosted backend as a service, providing the infrastructure to manage database integrations and expose public data interfaces for external application access. The platform includes an AI agent orchestrator for deploying autonomous agents that interact with business data and execute operational tasks. It differentiates itself through self-hosted infrastructure management, allowing the system to run on priva

AnyCrawl is an AI-powered data extractor, automated web crawler, and headless browser orchestrator. It serves as a web content extraction API and a gateway that connects crawling and scraping tools to language models using a standardized API protocol. The project specializes in converting unstructured website content into structured JSON or markdown optimized for AI assistants. It utilizes language models and JSON schemas to pull specific information into validated formats and provides capabilities for AI page summarization and LLM-optimized content extraction. The system manages comprehensi

Obscura is a web scraping infrastructure and headless browser server designed for AI agents. It provides a system for AI models to control browser sessions, interact with websites, and extract web data using a WebSocket implementation of the Chrome DevTools Protocol. The project focuses on bot detection evasion by randomizing browser fingerprints, masking native functions, and blocking tracking scripts to mimic human behavior. It further secures identities through a traffic layer that routes network requests via HTTP or SOCKS5 proxies. The system supports large-scale data extraction through

req is a chainable HTTP client library for Go designed to simplify request configuration and automatic response decoding into structures. It provides a fluent-interface request builder that allows developers to incrementally define request properties and encapsulate HTTP logic into reusable API SDKs. The project distinguishes itself with a TLS fingerprint emulator that mimics browser network signatures to bypass bot detection and crawler filters. It also includes a concurrent file downloader that increases transfer speeds by fetching large remote files in parallel segments. The library cover