cooderl/wewe-rssArchived
Wewe Rss
wewe-rss is an RSS feed generator and scheduled aggregator that converts social media accounts and web content into standardized RSS, Atom, or JSON feeds. It functions as a full-text content extractor, retrieving the complete body of articles rather than short summaries.
The system operates as an API-protected feed gateway, utilizing token-based authorization and request rate limiting to restrict access and maintain stability. It supports subscription portability by exporting tracked sources into standardized OPML files.
The project manages content aggregation through automated polling via cron expressions, manual update triggers, and historical article retrieval. It includes content filtering capabilities based on title keywords to refine the generated feeds.
Features
- RSS Feed Generation - Converts scraped social media and web data into standardized RSS, Atom, and JSON feeds.
- Content Aggregators - Consolidates content from various social and web sources into a single, filtered feed.
- Content Extractors - Retrieves the complete article body from web sources by removing boilerplate elements.
- Content Extraction Engines - Parses raw HTML from websites to normalize and extract the full body text of articles.
- Source Subscription Managers - Manages and schedules the automatic retrieval of updates from configured external feed sources.
- Text Extraction - Extracts the complete body text of a post instead of a short summary.
- Feed Refresh Scheduling - Implements a background worker that refreshes subscription content on a fixed timetable using cron expressions.
- Feed Content Filtering - Applies keyword-based filters to include or exclude specific articles from a generated feed.
- OPML Subscription Exports - Generates standardized OPML files to allow the migration of tracked subscription sources to other readers.
- Cron Scheduling - Uses cron expressions to automate the periodic refreshing of content feeds from external sources.
- Social Media Content Retrievers - Retrieves previously published historical posts from social media accounts to populate feeds.
- API Access Restrictions - Requires a specific authorization code for API requests to prevent unauthorized access to the system.
- Rate Limiting - Caps the number of requests per minute to prevent service overload and ensure system stability.
- Feed Content Filtering - Filters feed entries by matching article titles against user-defined keywords.
- Feed Generators - Converts WeChat official account articles into RSS feeds.
