JoeanAmier/XHS-Downloader
XHS Downloader
XHS-Downloader is a media downloader and content scraper for Xiaohongshu designed to extract and save images, videos, and metadata from profiles, search results, and shared links. It functions as a background service that can automatically detect and download media when platform URLs are copied to the system clipboard.
The project provides a server with an HTTP API endpoint for programmatically triggering media downloads and extracting work details via external scripts. It includes a media asset manager that sorts downloaded content into custom folders using filename patterns based on author and work metadata.
The system supports bulk profile backups through recursive crawling of user profiles and search results. It utilizes a database-backed tracking system to prevent redundant downloads and implements resumable transfers to ensure complete media recovery.
Features
- Media Downloaders - Extracts and saves images, videos, and metadata from Xiaohongshu profiles, search results, and shared links to local storage.
- Media Downloaders - Retrieves images and videos from web addresses with support for file-type identification and resumable transfers.
- Social Media Scrapers - Collects posts, bookmarks, and user metadata from the platform for local storage and analysis.
- Profile Archivers - Provides a way to backup all published albums and posts from a specific user profile into local archives.
- Community Content Downloaders - Automatically triggers the retrieval and download of user-generated content from social media libraries via clipboard monitoring.
- Content Extraction Engines - Extracts structured posts, images, videos, and bookmarks from user profiles into a usable local format.
- Recursive Content Crawlers - Traverses user profiles and search results recursively to collect all associated media links and metadata.
- Clipboard Managers - Monitors the system clipboard in the background to trigger automatic downloads when valid links are detected.
- Automatic Triggered Downloaders - Functions as a background service that automatically downloads media when specific social media URLs are copied.
- Clipboard Event Listeners - Implements a background listener that automatically initiates downloads when matching social media URLs are copied.
- Social Media Content Retrievers - Fetches media, captions, and metadata from social media profiles via a programmatic API endpoint.
- Media Content Archivers - Saves images and videos from profiles and search results to local storage for permanent offline use.
- Social Media Extraction Tools - Provides programmatic utilities to scrape posts, bookmarks, and user profile data from the Xiaohongshu platform.
- Media Content Managers - Implements a system for organizing downloaded media into custom local folders based on author and work metadata.
- Automated File Organizers - Organizes downloaded media into custom folders using rule-based filename formats derived from author metadata.
- Search Result Extractors - Collects work and user links directly from the results of search query pages.
- Media Deduplication - Uses a database to track processed content identifiers, preventing redundant downloads of the same media files.
- File Storage and Metadata Management - Extracts detailed work information and saves the associated metadata into local files for future reference.
- Download API Interfaces - Exposes a programmatic HTTP interface to trigger media extraction and downloads via POST requests.
- Automated Media Extractors - Provides a server endpoint to programmatically trigger media extraction and downloads via HTTP POST requests.
- Filename Templates - Generates local folder structures and filenames using customizable metadata patterns based on author and work details.
- Programmatic Extraction APIs - Provides a server endpoint that allows external tools to programmatically trigger content extraction and media downloads.
- Download Managers - Maintains a database of download records to manage queues and avoid redundant retrieval of the same content.
