Y2Z/monolith
Monolith
Monolith is a single-file HTML web archiver and asset bundler. It functions as a command-line interface and programmatic library designed to save complete web pages and their associated assets into a single HTML file for offline viewing.
The tool crawls URLs to discover and fetch linked stylesheets, scripts, and images, which are then embedded into the document as data URLs. It includes capabilities for session injection via external cookie files and authentication handling to backup protected or member-only content.
The project covers broader functional areas including automated web scraping, asset filtering by domain or resource type, and network request customization. It also supports proxy routing through environment variables to manage network restrictions.
Features
- Single-File Web Archivers - Provides the core capability of saving complete web pages and their assets into a single HTML file for offline viewing.
- Web Page Archiving - Saving complete websites as single HTML files to preserve content and styling for permanent offline access.
- Offline Single-File Applications - Bundles complete web pages and assets into a single HTML or MHTML file for offline viewing.
- Web Content Extraction Utilities - Implements a programmatic interface for collecting web content and media into single files for offline use.
- Base64 Asset Embedding - Converts external page assets into base64 encoded data URIs for embedding directly within the HTML file.
- DOM Resource Crawlers - Traverses the page DOM recursively to find and fetch all associated stylesheets, scripts, and images.
- HTML Asset Bundlers - Embeds images, styles, and scripts into HTML files using data URLs to preserve page layout offline.
- Offline Web Page Archivers - Saves complete web pages as local files by crawling URLs and combining all content into one document.
- Single-File Distributions - Bundles page source and assets into a single standalone HTML file for offline distribution.
- Asset Type Filters - Allows users to exclude specific resource types, such as video or scripts, from the final bundle.
- Dynamic to Static Conversion - Transforms dynamic web pages into portable HTML files by embedding all assets as data URLs.
- Resource Domain Filters - Allows restricting asset retrieval to specific domains to control which external resources are bundled.
- Authenticated Content Backups - Preserves private or member-only web data by handling session cookies during the archiving process.
- Domain-Restricted Crawling - Limits the crawling process to a specific root domain or block-list to control asset inclusion.
- Page Bundling Automation - Provides programmatic and command-line interfaces to automate the bundling of multiple URLs.
- Authentication Handling - Includes mechanisms for managing user identity and session cookies to access protected or member-only web content.
- Cookie-Based Authentication Bridges - Enables the use of external cookie files to inject authenticated sessions for capturing protected content.
- Web Scraping and Automation - Programmatically captures full page snapshots and assets from multiple URLs at scale.
