Projects sharing features with Instagram Crawler

Douyin-Bot is a Python-based automation tool designed for interacting with Douyin accounts through automated likes, follows, and comments. It functions as a computer vision social bot that uses face recognition and image analysis to filter profiles based on visual criteria. The project distinguishes itself by using aesthetic content filtering to trigger social actions only when a user meets a specified beauty threshold. To reduce the risk of account bans, it incorporates account safety management that mimics human behavior through randomized delay scheduling. The framework covers a broad ran

igbot is an Instagram automation bot that handles routine social media interactions on Instagram, including following, unfollowing, liking, and commenting on posts and profiles. It also functions as a video metadata extractor, retrieving download URLs, view counts, and audio information from Instagram Reels and public short videos. To carry out these actions, the bot combines GraphQL API scraping with headless browser automation, mimicking human behavior through randomized action timing, session cookie persistence, and user agent rotation. A task queue with exponential backoff retry ensures r

Social-analyzer is an open-source intelligence framework designed for the automated discovery, correlation, and verification of digital identities across online platforms. It functions as a comprehensive engine for gathering social media intelligence, utilizing distributed browser automation to extract metadata and profile information from hundreds of websites simultaneously. The platform distinguishes itself through its ability to perform cross-platform identity correlation using heuristic-based pattern matching and name permutation generation. It processes these findings through a confidenc

This project is a collection of Python scripts and tools designed for web scraping, browser automation, and large-scale data extraction. It provides a set of implementations for retrieving information from websites and private APIs, including tools for multimedia downloading and social media data archiving. The toolset includes specialized mechanisms for bypassing anti-scraping measures through IP proxy pool rotation and multi-threaded crawlers. It also features capabilities for simulating browser sessions to handle authentication, intercepting session cookies, and decrypting network payloads

Botasaurus is a Python web scraping framework and headless browser automation system used to build scalable data extraction tools. It functions as a web data extraction tool and OCR document parser, converting website content, images, and PDF files into structured formats such as JSON, CSV, and Excel. The framework distinguishes itself by providing a scraper management interface that allows Python functions to be wrapped in a web-based UI or deployed as standalone desktop applications. This enables non-technical users to trigger extraction jobs and manage tasks via a graphical interface or RE

gstack is an AI agent framework and development workflow system designed to automate the software development lifecycle. It coordinates specialized AI personas to manage tasks across product design, engineering management, and quality assurance, transforming product intent into technical specifications and final releases. The project is distinguished by its deep integration of headless browser automation and semantic code memory. It utilizes a persistent Chromium daemon for web scraping and visual auditing, and implements a searchable knowledge base that logs architectural decisions and repos

Osintgram is a command-line utility designed for open-source intelligence gathering and the extraction of public data from social media profiles. It functions as a framework for collecting and processing user information to assist in digital investigations and the mapping of digital footprints. The tool distinguishes itself through a modular architecture that organizes intelligence-gathering tasks into independent scripts, all sharing a unified session state and data processing pipeline. It utilizes headless browser automation and session-based interactions to mimic legitimate user behavior,

Toutatis is an open-source intelligence tool designed to extract public account information, emails, and phone numbers from Instagram profiles. It functions as a command-line utility for gathering user details and contact information for research purposes. The tool provides capabilities for public identity verification and account intelligence by translating usernames into internal unique identifiers to retrieve associated profile data. The system handles data extraction through a command line interface, utilizing request simulation and session-based API interactions to parse structured data

This project is a collection of Python implementations for web scraping, network traffic interception, data analysis, and sentiment analysis. It provides methods for extracting structured data from websites and mobile application interfaces. The collection includes tools for capturing and analyzing network packets from mobile applications to identify hidden internal API endpoints. It also features scripts for evaluating the emotional tone and public perception of text data. The project covers data manipulation and transformation of large datasets, as well as the generation of charts and grap

ECommerceCrawlers is an educational collection of Python-based crawler scripts designed to extract data from a variety of public websites, including e-commerce platforms, social media sites, news outlets, and multimedia sources. The project serves as a learning resource for web scraping techniques, offering ready-to-run examples that demonstrate practical data extraction methods. The toolkit covers a broad range of data types, including product listings and prices from online retail platforms, public posts and profiles from social networking sites, articles from news and blogging platforms, p

Telegram-Media-Downloader is a web media scraper and restricted content downloader designed to extract images and videos from the Telegram web interface for local storage. It functions by programmatically automating a web browser to capture media from chats and stories. The utility specifically enables the recovery of restricted content from groups and channels where administrators have disabled the native download function. It bypasses these restrictions by identifying media elements within the browser to locate source URLs. The system includes capabilities for session-based authentication,

This Python library is a private API wrapper that provides programmatic access to Instagram features by communicating with internal mobile endpoints. It functions as a social media automation toolkit for managing profiles, publishing media, and interacting with the social graph. The library uses a reverse-engineered API to mimic the communication patterns and request headers of mobile applications. It incorporates a session manager that persists authentication cookies and client metadata to maintain active logins and reduce the frequency of authentication handshakes. Its capabilities cover m

This project is a web scraping authentication tool designed to automate login simulations and bypass authentication walls. It provides utilities for programmatically navigating login screens to gain access to protected web content and restricted data. The software specifically enables session establishment through QR code authentication, allowing users to scan a code with a mobile device to capture and save authentication cookies. These captured sessions are used to maintain persistence for future automated requests. The tool covers broader capabilities in browser-based automation, including

OpenCLI is an AI browser automation framework designed to automate web navigation, data extraction, and repetitive browser tasks. It functions as a browser-based CLI generator that converts website interfaces into command-line interactions by controlling authenticated web browser sessions. The project features a web-to-CLI adapter platform for mapping web elements to programmatic command-line inputs and outputs. It includes a browser profile manager to organize and switch between isolated session profiles to maintain different user identities. The toolkit provides capabilities for web conten

Riona-AI-Agent is an LLM automation agent and browser automation framework designed to execute complex workflows, train on custom data, and generate AI content. It functions as a social media automation tool for scheduling content, managing multiple profiles, and automating engagement actions across social platforms. The system includes a centralized monitoring dashboard for tracking the live status, runtime summaries, and activity logs of AI agents. It utilizes machine learning models to identify and bypass visual security challenges during automated browsing sessions. The agent's capabilit

Spider is a web-based platform designed for automated data extraction, providing a centralized framework to collect, process, and route structured information from websites. It functions as a comprehensive pipeline that manages the entire lifecycle of data gathering, from initial configuration to final storage in external databases or message queues. The platform distinguishes itself through a visual configuration interface that allows users to define extraction rules and manage scraping templates without writing custom code. It supports both static and dynamic content retrieval by integratin

Damaihelper is a ticketing automation bot and browser automation framework designed to monitor ticket availability and execute checkout processes. It utilizes a ticket purchasing script to automate the selection and purchase of tickets on web platforms based on predefined user criteria. The tool includes a graphical user interface for managing scripts and configuring automation parameters, allowing users to trigger tasks without using a command line. To maintain access, it employs browser session management to save and reuse authentication cookies, avoiding repetitive manual login procedures.

This project is an Amazon web scraper and e-commerce data extractor designed to retrieve product names, prices, and ratings. It functions as a headless browser crawler that converts unstructured web content from product listings into structured JSON and CSV formats. The tool incorporates anti-bot bypass capabilities to circumvent CAPTCHAs and security challenges. It achieves this through the use of residential proxy integration, automatic proxy rotation, and the modification of browser fingerprints to simulate human interaction patterns. The system provides broad web scraping capabilities, i

CrawlerTutorial is a comprehensive Python web scraping tutorial and framework designed for extracting data from static and dynamic websites. It functions as a web data extraction pipeline and an HTTP request orchestrator, covering the full lifecycle of scraping applications from initial fetching to final data storage. The project provides specialized guidance on anti-bot bypass techniques and web API reverse engineering. It includes methods for evading browser detection through identity masking and proxy rotation, as well as techniques for identifying hidden API endpoints by analyzing network

This project is a ticket purchase automation tool and browser automation bot designed to secure high-demand event tickets. It functions as a web scraping purchase script that monitors availability and executes checkout transactions programmatically. The tool utilizes a hybrid execution model that combines headless browser automation for authentication and session management with direct HTTP requests to ticketing server APIs. This approach is used to bypass user interface latency and handle high-speed request processing during flash sales. The system includes capabilities for automated availa

Playwright-cli is a command line interface for executing web tasks and automating browser interactions using the Playwright framework. It serves as a browser binary manager for downloading and installing specific browser engines and their required system dependencies, as well as a tool for running automated test suites across multiple engines to verify application behavior. The utility functions as a browser session controller, managing browser profiles and persistent storage states via the command line. It enables the execution of automation suites across different browser engines and config

biliTickerBuy is a Bilibili ticket purchase automator and web-based ticketing bot. It functions as an e-commerce checkout script designed to automate the acquisition of limited inventory tickets on the Bilibili platform to increase purchase speed. The tool handles Bilibili event ticketing and the acquisition of limited inventory items. It automates the checkout process to bypass manual entry and increase the success rate of securing high-demand event entries. The project utilizes headless browser automation and request-based sequence scripting. It includes capabilities for polling-based inve

Spider_XHS is a data extraction and automation tool built specifically for the Xiaohongshu social platform. It orchestrates multi-step workflows that combine comment tree traversal, cookie-based session reuse, high-resolution media retrieval, keyword search, proxy-backed retries, QR-code login, structured file export, and aggregated user profile collection into a single pipeline. The tool distinguishes itself through its integrated authentication and publishing capabilities, supporting login via QR code scanning or phone verification codes to establish and maintain authenticated sessions. It

Twikit is a Python library and API wrapper designed for interacting with X (Twitter). It simulates browser requests and mimics private network traffic to enable programmatic access to the platform without requiring an official API key. The project focuses on social media automation and data extraction, featuring tools for scraping user profiles, trending topics, and chronological tweet histories. It includes a session manager that handles user authentication, two-factor authentication, and cookie persistence to maintain active account access. The library's capabilities cover a broad range of

This project is a Model Context Protocol tool that connects local browser instances to AI agents, enabling programmatic control over web sessions. It functions as a browser automation framework, allowing for the navigation of pages, interaction with form elements, and the management of user data while maintaining existing authentication states and profiles. The utility distinguishes itself by enabling local analysis of browser content, including the extraction of text and the performance of semantic searches across open tabs without transmitting private data to external servers. It also provi

Twint is an open-source intelligence and data extraction framework designed to gather public social media information. It functions as a command-line utility that retrieves posts, user profiles, and follower lists directly from web interfaces, bypassing the need for official platform developer credentials or authentication keys. The tool distinguishes itself by enabling automated, large-scale data collection through terminal-based orchestration. It supports granular filtering by keywords, geographic locations, time ranges, and account status, allowing researchers to build targeted datasets fo