RSS-Bridge/rss-bridge
Rss Bridge
RSS-Bridge is a self-hosted feed generator and proxy that transforms website content from sources without native feeds into standardized Atom, RSS, or JSON web feeds. It functions as a web scraping system that extracts data from pages using CSS selectors and XPath to create structured data streams for feed readers.
The project is designed for extensibility, allowing for the development of custom bridges to fetch and parse data from new target websites. It includes capabilities for feed aggregation and filtering, enabling the merging of multiple data sources into a single feed and the removal of noisy items using keyword thresholds.
The application includes a pluggable cache backend supporting file systems, SQLite, or Memcached to reduce external requests. Access to the hosted instance can be restricted using authentication tokens or HTTP Basic Authentication, and error reporting can be configured to manage how bridge failures are communicated.
Features
- Syndication Feed Generators - Automatically generates standardized RSS, Atom, and JSON feeds from website content for use in feed readers.
- RSS Feed Generation - Transforms website content that lacks native feeds into structured web feeds using a standardized parsing API.
- Feed Serialization - Converts parsed internal data structures into standardized output formats such as Atom, JSON, and HTML for feed readers.
- Web Scraping - Extracts specific data from web pages using CSS selectors and XPath to create organized data streams.
- Web Scraping Selectors - Uses CSS selectors and XPath expressions to isolate and extract specific data points from unstructured HTML pages.
- Web Scraping Tools - Extracts data from web pages using CSS selectors and XPath to create structured data streams for feeds.
- Feed Content Filtering - Provides tools to remove unwanted or noisy items from generated content streams using keyword matching and thresholds.
- Feed Filtering Heuristics - Combines multiple data sources into a single feed and filters out noisy items using keyword thresholds.
- Cache Backends - Supports pluggable cache backends including file systems, SQLite, and Memcached to optimize performance and reduce external requests.
- Custom Parser Development - Enables the creation of specific parsing logic to fetch and structure data from new target websites for feed readers.
- Self-Hosted Applications - Provides a server-side application for fetching and caching remote web content to ensure reliable feed delivery.
- Custom Bridge Extensibility - Provides a mechanism to implement specific classes for fetching and parsing data from new target websites to expand available feeds.
- Feed Generation and Transformation - Generates RSS feeds for websites that do not provide them.
- RSS Feed Generation - Generates RSS feeds for websites that do not provide them natively.
- Feed Readers - Generates RSS feeds for websites lacking native support.
- Feed Readers - Listed in the “Feed Readers” section of the Awesome Selfhosted awesome list.
