awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
pirate avatar

pirate/ArchiveBox

0
View on GitHub↗
archivebox.io↗

ArchiveBox

ArchiveBox is a self-hosted web archiving system designed to capture and preserve permanent static copies of webpages, media, and PDFs on personal infrastructure. It functions as a digital content curator and personal web archive manager, allowing users to import URLs from bookmarks, RSS feeds, and browser history to create a centralized, searchable knowledge base.

The project is distinguished by its ability to archive private, paywalled, or login-protected content using browser cookies and authenticated session persistence. It ensures long-term availability by saving pages in multiple concurrent formats, including HTML, PDF, and PNG, and can automatically mirror these local snapshots to external preservation services.

The system includes capabilities for multimedia asset extraction, full-text archive indexing, and scheduled content mirroring. Users can manage their collections through a web-based interface, a command-line interface, or a remote API, with options to export the entire collection as a standalone static HTML site for offline browsing.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Digital Preservation Tools - Captures and maintains long-term accessible versions of web content in multiple preservation-grade formats like PDF and PNG.
  • Web Content Archivers - Captures permanent static copies of webpages, including HTML, JavaScript, PDFs, and media.
  • Personal Knowledge Management - Collects and organizes bookmarks, RSS feeds, and browser history into a centralized, searchable personal knowledge base.
  • Content Aggregation & Curation - Collects and organizes content from bookmarks, RSS feeds, and history into a centralized knowledge base.
  • Session Data Archivers - Uses browser cookies and user profiles to download and store content generated during private web sessions.
  • Content Formats and Exporting - Saves static copies of web content in HTML, PDF, and PNG formats to ensure long-term availability.
  • Self-Hosted Web Archivers - Captures and stores permanent static copies of webpages, media, and PDFs on personal infrastructure.
  • External Feed Integrations - Automatically pulls fresh URLs from RSS feeds on a recurring timetable.
  • Local Filesystem Storage - Saves archived webpages and media directly to the local server disk using a simple on-disk directory structure.
  • Web Archive Mirroring - Schedules recurring captures of websites and syncs local archives to external preservation services for redundancy.
  • Self-Hosted Link Managers - Provides a privately hosted system for managing and preserving collections of web links and static page copies.
  • Authenticated - Saves pages behind login walls or paywalls using browser cookies and authenticated session persistence.
  • Paywall Bypass Archiving - Captures pages that require authentication, cookies, or specific login credentials to access.
  • HTTP Cookie Persistence - Uses saved browser cookies to maintain authenticated sessions and capture private or paywalled web content.
  • Task Schedulers - Runs archiving tasks on a fixed timetable to automatically capture content.
  • Web-Based Control Panels - Provides a web-based user interface to control the archiving process and manage collections.
  • Preservation Formats - Saves webpages in multiple concurrent formats, including HTML, PDF, and PNG, for long-term preservation.
  • Programmatic Archive Managers - Provides a command-line interface and remote API to control archival tasks and manage tags.
  • Backup Storage Backends - Provides interfaces to back up preserved archives to remote object storage and external storage backends.
  • Bulk Media Acquisition - Downloads audio, video, and subtitles, and clones source code repositories for offline storage.
  • Link Data Imports - Provides utilities for importing web links and URL metadata from various structured formats including CSV and JSON.
  • Bookmark Importers - Implements importers for collecting web links from browser bookmark files and other external formats.
  • Third-Party Data Connectors - Utilizes data connectors to ingest web links from third-party archiving services into a local database.
  • Flat-File Storage - Maintains archives in a simple directory structure on disk to allow browsing without a database.
  • Full Text Search - Integrates with search backends to enable full-text discovery across the archived content corpus.
  • Search & Indexing Engines - Integrates external search backends to provide full-text discovery across the local corpus of archived pages.
  • Cloud Storage - Supports saving archived content to remote cloud storage providers and network shares.
  • External Archive Mirroring - Automatically sends local snapshots to external preservation services to ensure redundant storage of content.
  • Automated Asset Extractors - Detects and saves specific assets from pages such as videos, audio, and social media comments.
  • Archival Collection Managers - Provides a terminal interface for initializing collections and managing archived snapshots.
  • Environment Variable-Based Configuration - Configures bot behavior and server settings through system environment variables and configuration files.
  • Asynchronous Task Queues - Processes archiving and import jobs through an asynchronous queue to prevent UI blocking.
  • Crawler Behavior Configurations - Allows customization of extraction methods and bot identification via configuration files and environment variables.
  • Extraction Plugins - Employs specialized plugin-based scrapers to detect and download diverse media assets and source code.
  • Data Management Systems - Self-hosted web archive for creating browsable local backups.
  • Internet Services - Self-hosted web archiving for creating local browsable backups.
  • Content Delivery - Self-hosted tool to archive web content from RSS feeds.
  • Web Archiving - Platform for archiving and organizing website content.
27,721 stars·1,538 forks·Python·MIT·39 views

Star history

Star history chart for pirate/archiveboxStar history chart for pirate/archivebox

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does pirate/archivebox do?

ArchiveBox is a self-hosted web archiving system designed to capture and preserve permanent static copies of webpages, media, and PDFs on personal infrastructure. It functions as a digital content curator and personal web archive manager, allowing users to import URLs from bookmarks, RSS feeds, and browser history to create a centralized, searchable knowledge base.

What are the main features of pirate/archivebox?

The main features of pirate/archivebox are: Digital Preservation Tools, Web Content Archivers, Personal Knowledge Management, Content Aggregation & Curation, Session Data Archivers, Content Formats and Exporting, Self-Hosted Web Archivers, External Feed Integrations.

Which projects share features with pirate/archivebox?

Projects with overlapping indexed features include: awesome-selfhosted/awesome-selfhosted — This project is a community-curated directory of open-source software designed for deployment in private server… karakeep-app/karakeep — Karakeep is a self-hosted, open-source platform designed for personal knowledge management and web content archiving.… getgrav/grav — Grav is a flat-file content management system that eliminates the need for a traditional database by storing site… jarun/buku — Buku is a personal bookmark manager that provides a command line interface, a portable bookmark database, and a… worldbrain/memex — Memex is a browser extension knowledge base and personal information manager designed for indexing, annotating, and… readest/readest — Readest is a comprehensive digital reading platform designed to manage, annotate, and consume electronic books across…

Projects sharing features with ArchiveBox

These projects share indexed features with ArchiveBox. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • awesome-selfhosted/awesome-selfhostedawesome-selfhosted avatar

    awesome-selfhosted/awesome-selfhosted

    334,819View on GitHub↗

    This project is a community-curated directory of open-source software designed for deployment in private server environments and home labs. It serves as a comprehensive resource for discovering independent, self-hosted alternatives to mainstream cloud services, enabling users to maintain full data ownership and control over their digital infrastructure. The directory is structured through a hierarchical taxonomy that organizes a vast collection of applications into logical categories, ranging from media management and data analytics to private communication and team productivity tools. It dis

    awesomeawesome-listcloud
    View on GitHub↗334,819
  • karakeep-app/karakeepkarakeep-app avatar

    karakeep-app/karakeep

    30,385View on GitHub↗

    Karakeep is a self-hosted, open-source platform designed for personal knowledge management and web content archiving. It functions as a centralized repository where users can capture, organize, and preserve bookmarks, notes, and media files, ensuring long-term access to digital information even if original sources are removed or modified. The system distinguishes itself through its automated content processing and security-focused architecture. It utilizes headless browser crawling and optical character recognition to ingest and index web content, while a modular artificial intelligence pipel

    TypeScriptbookmark-managerbookmarksbookmarks-manager
    View on GitHub↗30,385
  • getgrav/gravgetgrav avatar

    getgrav/grav

    15,718View on GitHub↗

    Grav is a flat-file content management system that eliminates the need for a traditional database by storing site content and configuration in human-readable Markdown and YAML files. Built as a modular PHP web framework, it uses a hierarchical page routing system where the physical directory structure directly determines the site's URL paths. The platform is distinguished by its event-driven plugin architecture and a command-line interface that prioritizes system administration, deployment, and maintenance tasks. It utilizes a blueprint-driven system to generate administrative forms from stru

    PHPcmscontentcontent-management
    View on GitHub↗15,718
  • jarun/bukujarun avatar

    jarun/buku

    7,251View on GitHub↗

    Buku is a personal bookmark manager that provides a command line interface, a portable bookmark database, and a self-hosted server for organizing web links. It functions as a command line knowledge base for saving, tagging, and searching web resources. The system features a portable, mergeable database that supports AES-256 encryption and is designed for cross-device data synchronization. It includes a RESTful API and a self-hosted web interface, allowing users to manage their collection via a browser or programmatic requests. Capabilities include automatic metadata fetching to populate page

    Pythonbookmarkbookmark-managerbookmarks
    View on GitHub↗7,251
Compare all 30 related projects→