Projects sharing features with Twitter Scraper

TrendFinder is an AI-powered trend monitoring tool and sentiment analysis platform. It functions as a social media content aggregator that collects posts and articles from influencers and websites to identify emerging patterns and industry news. The system utilizes large language models to process collected web data and determine the relevance of trending topics. It operates as an automated notification system, delivering contextual alerts and source links to messaging platforms when significant online activity is detected. The platform covers automated market intelligence and real-time tren

This project is a specialized TikTok API scraper and data extractor. It functions as a proxy-based web scraper designed to collect user metadata, video posts, and trend feeds, while providing a webhook data pipeline to route scraped information to external URLs via HTTP requests. The tool includes a watermark-free video downloader that saves high-definition content to local storage. It employs cryptographic request signing for server authentication and utilizes session cookie authentication combined with proxy rotation to manage network traffic and avoid rate limits. Capabilities cover bulk

Weibospider is a distributed web crawler designed to extract posts, profiles, and interaction data from the Weibo social network. It functions as a social media data extractor that utilizes a distributed task queue to scale scraping operations across multiple worker nodes. The system includes a graphical administrative interface for configuring crawler settings, target user identifiers, and search keywords. It employs a distributed architecture to increase data throughput and manage large-scale collection of social media content. The tool covers a wide range of data collection capabilities,

This project is a Ruby wrapper for the Twitter API, providing a programmatic interface to interact with the platform's REST and streaming endpoints. It serves as an API client for managing social content, users, and account activity. The library includes specialized tools for real-time data streaming, allowing the acquisition of live public posts, account events, and user activity. It differentiates itself with advanced media handling, such as chunked uploading for large files, and integrated traffic management to monitor rate limits and detect streaming stalls. Broadly, the project covers c

Toutatis is an open-source intelligence tool designed to extract public account information, emails, and phone numbers from Instagram profiles. It functions as a command-line utility for gathering user details and contact information for research purposes. The tool provides capabilities for public identity verification and account intelligence by translating usernames into internal unique identifiers to retrieve associated profile data. The system handles data extraction through a command line interface, utilizing request simulation and session-based API interactions to parse structured data

This project is an unofficial TikTok API client and Python library. It functions as a data scraper and API wrapper for programmatically retrieving public profile information and trending media from the TikTok platform. The library enables the extraction of user identity details and the retrieval of trending video content. It provides tools for social media automation, trend analysis, and content research.

WechatSogou is a Python library that provides a programmatic bridge to WeChat content by scraping Sogou's search engine results. It resolves WeChat account profile pages to article lists, filters trending articles by predefined categories, and manages browser-like cookie sessions to maintain authenticated access. The library parses raw HTML to extract article metadata, account details, and keyword suggestions, while dynamically adjusting request frequency to avoid IP blocking. The project offers capabilities for searching WeChat public accounts and articles by keyword, returning profile detai

This project is a standalone utility that enables one-click video downloading from WeChat Channels by intercepting the network traffic of the WeChat desktop client. It operates as a local HTTP proxy positioned between the desktop app and the internet, capturing video streams and adding a download button directly into the app's built-in media player interface. What distinguishes this tool is its use of real‑time network‑layer augmentation rather than modifying the desktop client itself. It patches HTTP responses as they pass through the proxy to inject interactive download controls, and on the

Strawberry is a type-safe GraphQL library for Python that enables the design of schemas using Python type annotations and dataclasses. It functions as an asynchronous GraphQL server and execution engine, providing a bridge to expose schemas across ASGI-compliant web frameworks such as FastAPI, Django, Flask, and Litestar. The project implements GraphQL Federation, allowing for the creation of distributed schemas and entities that merge into a unified supergraph across multiple services. It also includes a dedicated toolkit for the Relay specification, supporting global object identification a

This project is a REST API client library and Google Cloud SDK component that integrates Python applications with Google services. It functions as a discovery-based API client, utilizing an OAuth 2.0 integration library to secure requests and verify identity through access tokens and service accounts. The library is distinguished by its use of discovery documents to dynamically generate clients at runtime. By parsing JSON metadata, it maps Python method calls to HTTP requests and builds interface-based resource models that mirror the hierarchical structure of the remote service. Its broader

This is an asynchronous HTTP client for Android that simplifies network requests by wrapping Apache HttpClient. It provides a callback-based networking library for fetching remote data and communicating with servers without blocking the user interface. The project includes a multipart HTTP uploader for sending binary files and large data payloads, as well as a JSON parser to convert raw response text into structured data objects. It features a session manager that persists cookies in local application preferences to maintain state across multiple requests. Additional capabilities include aut

🔮 Graphile's Crystal Monorepo; home to Grafast, PostGraphile, pg-introspection, pg-sql2 and much more!

🚀 A Complete Fast Android Networking Library that also supports HTTP/2 🚀

ECommerceCrawlers is an educational collection of Python-based crawler scripts designed to extract data from a variety of public websites, including e-commerce platforms, social media sites, news outlets, and multimedia sources. The project serves as a learning resource for web scraping techniques, offering ready-to-run examples that demonstrate practical data extraction methods. The toolkit covers a broad range of data types, including product listings and prices from online retail platforms, public posts and profiles from social networking sites, articles from news and blogging platforms, p

Rest-assured is a Java-based REST API testing framework and HTTP client library designed for automating web service tests. It provides a fluent domain-specific language and assertion library to send HTTP requests and validate response metadata, including status codes, headers, cookies, and bodies. The framework is distinguished by a method-chaining DSL that creates readable specifications for API interactions. It features a filter-based request interception pipeline, object-mapping serialization for converting Java objects to JSON or XML, and a path-based parsing system to isolate specific fi

Oasis is an LLM-powered multi-agent social simulator and research tool designed to study synthetic social phenomena. It functions as a synthetic social network platform, replicating the infrastructure of social sites including user profiles, follow relationships, and content discovery mechanisms to model human-like social behaviors at scale. The framework orchestrates large-scale agent populations, supporting up to one million autonomous agents. It distinguishes itself by translating language model outputs into concrete social actions and external tool executions through a tool-calling orches

weiboSpider is a Python web scraper and social media crawler designed to extract user profiles, posts, and engagement metrics from Sina Weibo. It functions as an automated data pipeline for academic research and trend analysis, collecting long-form text and multimedia content. The tool distinguishes itself through the use of browser session cookies to authenticate requests and access protected profiles. It implements randomized request pacing and global pauses to manage traffic and avoid platform rate limits, while supporting incremental crawling to capture only new content based on timestamp

AndroidNetworking is an HTTP networking library for Android that handles the full lifecycle of network communication, from sending requests to parsing responses and caching data. It provides a unified interface for executing GET, POST, PUT, DELETE, HEAD, and PATCH requests, with support for both synchronous and asynchronous execution, and includes built-in JSON response parsing that converts server responses directly into Java objects or lists. The library distinguishes itself through a set of integrated capabilities that go beyond basic request execution. It manages file downloads and upload

Pothos is a code-first GraphQL schema builder and framework designed for type-safe development. It allows developers to construct schemas using typed definitions in TypeScript, eliminating the need for external code generation steps. The framework distinguishes itself through a dedicated data mapper that connects GraphQL types to relational databases and ORMs, such as Prisma, while optimizing query resolution. It provides a full implementation of the Relay specification, including global object identification and cursor-based pagination. The project covers several core capability areas, incl

This project is a Python web scraping tutorial and framework designed for building automated data extraction tools and web crawlers. It provides a structured approach to navigating websites and persisting scraped data to databases. The project includes a toolset for web API analysis, focusing on reverse engineering obfuscated API requests and inspecting network traffic to extract structured data. It also covers optical character recognition workflows to convert visual text within images into machine-readable strings. The framework covers capabilities for headless browser automation to handle

SpotiFLAC is a lossless music downloader and metadata search tool designed to source and save high-quality audio files. It functions as a Spotify lossless audio downloader that uses Spotify track information to locate and download high-fidelity audio tracks from alternative music providers. The utility enables high-fidelity music downloading and lossless audio archiving by finding audio tracks from different providers when the original streaming source lacks high-fidelity options. It allows for the acquisition of lossless audio tracks without requiring user accounts on provider platforms.

The feed generator is a framework for building and deploying custom algorithmic content feeds within the AT Protocol network. It provides the infrastructure to define unique curation logic, register these algorithms to user profiles, and serve personalized content streams to the network. The framework distinguishes itself by integrating real-time network activity indexing with a handler-based routing system. By consuming live event streams, it maintains local datasets that allow developers to apply custom sorting and filtering rules to public content. It manages the lifecycle of these feeds t

This project is a web scraping and automation tool designed to collect public data from Instagram and perform automated social media interactions. It functions by gathering profile details, captions, media files, and engagement metrics directly from web pages, bypassing the need for official developer interfaces or platform-specific credentials. The tool distinguishes itself by combining data extraction with automated engagement capabilities. It allows users to programmatically interact with content by liking posts that match specific search criteria or hashtags, aiming to increase account vi

Fuel is a Kotlin HTTP client library for Android and Kotlin applications that handles both synchronous and asynchronous web requests. It functions as a network wrapper that supports executing calls via suspending functions in coroutines, reactive streams, and traditional callbacks. The library features built-in integration for Android LiveData to bind network responses directly to observable state holders for user interface updates. It also includes a JSON serialization client that utilizes customizable mappers to convert raw HTTP response bodies into structured data objects. Capability area

Pattern is a Python web mining library that functions as an HTML web scraper, a natural language processing toolkit, and a network analysis tool. It provides a mathematical framework for categorizing datasets through a vector space model library. The project enables the extraction of structured data from web services and the creation of searchable web content indexes. It processes unstructured text using sentiment analysis, part-of-speech tagging, and n-gram searching. The library covers machine learning classification through the training of models using perceptron algorithms and support ve