chyroc/WechatSogou
WechatSogou
WechatSogou is a Python library that provides a programmatic bridge to WeChat content by scraping Sogou's search engine results. It resolves WeChat account profile pages to article lists, filters trending articles by predefined categories, and manages browser-like cookie sessions to maintain authenticated access. The library parses raw HTML to extract article metadata, account details, and keyword suggestions, while dynamically adjusting request frequency to avoid IP blocking.
The project offers capabilities for searching WeChat public accounts and articles by keyword, returning profile details such as name, ID, and authentication status, along with article titles, abstracts, and URLs. It can fetch detailed account information including introductions, QR codes, and recent posting statistics, as well as retrieve the most recent articles from an account's history with metadata like title, cover image, and publish time. The library also generates related keyword suggestions to refine searches and retrieves trending articles from WeChat's homepage by category.
Additional functionality includes parsing trending articles from specified categories and extracting paginated article URLs from account profile pages. The library's documentation covers installation and usage for these data extraction tasks.
Features
- WeChat-Sogou Scraping Bridges - Bridges WeChat data by scraping Sogou's search engine results and parsing HTML responses into structured JSON objects.
- Social Media Profile Extractors - Extracting detailed information for specific public accounts, such as introductions, QR codes, and recent posting statistics.
- WeChat Account Search - Searching for WeChat public accounts and articles by keyword, retrieving profile details, article metadata, and related search suggestions.
- Account Article Link Resolvers - Resolves WeChat account profile pages to article lists by following redirect chains and extracting paginated article URLs.
- Account Data Scrapers - An API client for searching WeChat public accounts and articles, fetching account details, and retrieving trending content programmatically.
- Account Article Metadata Retrievers - Retrieving recent articles from an account's history, including metadata like title, cover image, and publish time.
- Trending Article Retrievers - Retrieve trending articles from a platform's homepage by category, returning their titles, abstracts, and source account details.
- Account Article History Extractors - Extract the most recent articles from an account's history page, including metadata like title, cover image, and publish time.
- WeChat Article Extraction - Search for articles by keyword and return their titles, abstracts, URLs, and associated account info.
- WeChat - Search for public accounts by keyword and return their profile details, including name, ID, and authentication status.
- WeChat Account Search Tools - A client that searches for WeChat public accounts by keyword and returns profile details including name, ID, and authentication status.
- WeChat Article Search APIs - A tool that searches WeChat articles by keyword and returns titles, abstracts, URLs, and associated account metadata.
- Session & Cookie Handlers - Manages browser-like cookie sessions to bypass anti-scraping measures and maintain authenticated access to Sogou's search pages.
- Client-Side Adaptive Throttling - Adjusts request frequency dynamically based on HTTP response codes and retry-after headers to avoid IP blocking.
- PDF and HTML Content Extraction - Extracts article metadata, account details, and keyword suggestions by parsing raw HTML with regex and DOM traversal.
- Article List Retrieval - Retrieve trending articles from a specified category, such as food.
- Trending Article Category Filters - Filters trending articles by predefined categories (e.g., food, tech) using URL parameter manipulation and category ID mapping.
- WeChat Keyword Suggestions - Generating related keyword suggestions based on a given query to refine searches for accounts or articles.
- WeChat Trending Content - Fetching and parsing trending articles from WeChat platform categories, including titles, abstracts, and source account information.
- WeChat Account Detail Retrievers - Fetch detailed information for a specific public account, including its introduction, QR code, and recent posting stats.
- Search Keyword Suggesters - Generates related search terms by parsing Sogou's autocomplete API responses and filtering for WeChat-specific content.
Star history
How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
