danburzo/percollate
Percollate
Percollate is a command-line tool for converting web pages and RSS feeds into structured files. It functions as a web content converter, static document generator, and page bundler that transforms online content into PDF, EPUB, HTML, or Markdown formats.
The tool creates self-contained documents by embedding external images as encoded data URLs and applying custom HTML templates and CSS stylesheets. It can combine multiple web URLs or feed entries into a single digital book featuring a generated table of contents and hyperlinked index.
Additional capabilities include the decomposition of Atom and RSS feeds into individual articles and the sequential scheduling of requests to manage traffic pacing when retrieving content from servers.
Features
- Digital Book Generation - Combines multiple web pages or feed entries into single structured ebooks with tables of contents.
- Web Page Bundlers - Provides a utility to combine multiple web URLs into a single structured document featuring a generated table of contents.
- Document Templating - Uses customizable HTML and CSS templates to define the visual structure of exported documents.
- Feed-to-Document Conversion - Converts Atom or RSS feed entries into separate articles within a single document or individual files.
- Multi-Format Compilers - Transforms web content into multiple output formats including PDF, EPUB, HTML, and Markdown.
- Static Documentation Generators - Generates self-contained static documents from online content using custom HTML and CSS templates.
- Document Format Conversions - Transforms web pages, local files, or standard input into PDF, EPUB, HTML, or Markdown files.
- Document Output Customization - Provides mechanisms for defining visual styles and layouts of generated documents via custom CSS and templates.
- Feed-to-Article Decomposition - Parses RSS and Atom feeds to treat individual entries as distinct document chapters or separate files.
- Feed-to-Article Exports - Converts Atom or RSS feeds into a collection of readable articles for offline reading or distribution.
- RSS Feed Processors - Turns Atom and RSS feed entries into a series of structured articles or documents.
- Page Bundling Automation - Combines multiple web URLs into a single document or exports them as individual files.
- Web Content Parser CLI - Provides a command-line interface for transforming web pages and RSS feeds into various document formats.
- Self-Contained Document Exports - Exports documents as single files with all images and styles embedded for portable distribution.
- Web-to-Markdown Conversions - Transforms online articles into structured Markdown files for use in personal knowledge bases.
- Web Page Archiving - Saves web pages as permanent PDF or EPUB documents to ensure offline accessibility.
- Automatic Index Generation - Automatically generates a hyperlinked table of contents based on the bundled page hierarchy.
- Base64 Asset Embedding - Converts external image files into Base64 data URIs to create self-contained documents.
- Automatic Table of Contents - Automatically generates navigational outlines and tables of contents for bundled web content.
- Media Asset Embedding - Embeds external images as encoded data URLs to ensure documents are self-contained.
- API Request Scheduling - Implements sequential request scheduling with time delays to prevent server overloading and rate limiting.
- Client-Side Request Pacing - Implements sequential request scheduling with mandatory time delays to prevent server overloading and avoid rate limiting.
- Document Processing - CLI tool for converting web pages into PDF or EPUB.
