# archiveteam/grab-site

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/archiveteam-grab-site).**

1,592 stars · 156 forks · Python · NOASSERTION

## Links

- GitHub: https://github.com/ArchiveTeam/grab-site
- awesome-repositories: https://awesome-repositories.com/repository/archiveteam-grab-site.md

## Description

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

## Tags

### Part of an Awesome List

- [Web Archive Infrastructure](https://awesome-repositories.com/f/awesome-lists/devops/web-archive-infrastructure.md) — Python script for creating WARC archives from large websites.