# mikf/gallery-dl

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/mikf-gallery-dl).**

16,887 stars · 1,327 forks · Python · gpl-2.0

## Links

- GitHub: https://github.com/mikf/gallery-dl
- Homepage: https://discord.gg/rSzQwRvGnE
- awesome-repositories: https://awesome-repositories.com/repository/mikf-gallery-dl.md

## Topics

`danbooru` `deviantart` `downloader` `gallery` `kemono` `mangadex` `pixiv` `tumblr` `twitter`

## Description

Gallery-dl is a command-line utility designed for the automated retrieval and archiving of image collections from various hosting websites. It functions as a content scraper that manages the entire lifecycle of media discovery, from identifying assets on web pages to storing them in structured local directories.

The tool utilizes a plugin-based architecture to handle site-specific extraction logic, allowing it to map input web addresses to the appropriate modules through pattern matching. Users can define custom naming patterns and directory structures using configuration-driven templates, ensuring that downloaded media is organized according to specific local storage requirements.

Beyond basic retrieval, the software supports automated batch processing and can integrate with external tools to inject metadata directly into downloaded files. It operates through a synchronous terminal interface that coordinates sequential download queues and throttled network requests.

## Tags

### Graphics & Multimedia

- [URL Image Downloaders](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/media-downloaders/url-image-downloaders.md) — Automates the retrieval of entire image collections from hosting websites via command-line instructions. ([source](https://cdn.jsdelivr.net/gh/mikf/gallery-dl@master/README.md))
- [Media Downloaders](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/media-downloaders.md) — Provides a scriptable command-line interface for scraping and downloading media assets from online platforms.
- [Photo Galleries](https://awesome-repositories.com/f/graphics-multimedia/photo-galleries.md) — Automates the archiving of entire image collections to build local media libraries.
- [Playlist Content Retrievers](https://awesome-repositories.com/f/graphics-multimedia/streaming-distribution/streaming-broadcasting/media-streaming/playlist-aggregators/playlist-content-retrievers.md) — Automates the batch retrieval of visual media collections from web sources.
- [Download Organization Tools](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/media-downloaders/download-organization-tools.md) — Allows users to define custom naming patterns and directory structures for organizing downloaded media. ([source](https://cdn.jsdelivr.net/gh/mikf/gallery-dl@master/README.md))

### Data & Databases

- [Web Content Scrapers](https://awesome-repositories.com/f/data-databases/data-engineering-infrastructure/data-extraction-ingestion/web-extraction-engines/web-content-scrapers.md) — Functions as a scriptable command-line scraper for extracting media assets from web galleries.
- [Command-Line Storage Managers](https://awesome-repositories.com/f/data-databases/storage-abstraction/command-line-storage-managers.md) — Manages the download and structured local organization of media content through terminal commands.

### Software Engineering & Architecture

- [Media Plugin Architectures](https://awesome-repositories.com/f/software-engineering-architecture/integration-extensibility/extensibility/plugin-architectures/domain-specific/media-plugin-architectures.md) — Utilizes a modular plugin architecture to handle site-specific extraction logic for various hosting platforms.

### Development Tools & Productivity

- [Command Line Interfaces](https://awesome-repositories.com/f/development-tools-productivity/command-line-interfaces.md) — Operates as a terminal-based command-line utility for managing media discovery and storage.

### Web Development

- [Regex-Based URL Dispatchers](https://awesome-repositories.com/f/web-development/routing-systems/routing/matching-algorithms/regex-based-url-dispatchers.md) — Maps input web addresses to extraction modules using regular expression pattern matching.
- [Download Managers](https://awesome-repositories.com/f/web-development/download-managers.md) — Coordinates sequential download queues and throttled network requests for efficient media retrieval.

### DevOps & Infrastructure

- [Configuration-Driven Templating Engines](https://awesome-repositories.com/f/devops-infrastructure/configuration-management/template-and-generation-engines/configuration-driven-templating-engines.md) — Provides configuration-driven templates to dynamically generate file paths and naming conventions for downloaded media.