Projects sharing features with Instaloader

This project is a command-line utility designed to fetch video, audio, and image content from a wide range of web platforms. It functions by parsing page metadata and utilizing modular, site-specific scripts to extract direct media stream URLs from complex web structures, enabling the local archiving of digital media for offline use. The tool distinguishes itself through its ability to handle authenticated content, allowing users to inject browser-stored session cookies to access restricted or private media. It also supports real-time media streaming by piping remote content directly into ext

Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob

Social-analyzer is an open-source intelligence framework designed for the automated discovery, correlation, and verification of digital identities across online platforms. It functions as a comprehensive engine for gathering social media intelligence, utilizing distributed browser automation to extract metadata and profile information from hundreds of websites simultaneously. The platform distinguishes itself through its ability to perform cross-platform identity correlation using heuristic-based pattern matching and name permutation generation. It processes these findings through a confidenc

XHS-Downloader is a media downloader and content scraper for Xiaohongshu designed to extract and save images, videos, and metadata from profiles, search results, and shared links. It functions as a background service that can automatically detect and download media when platform URLs are copied to the system clipboard. The project provides a server with an HTTP API endpoint for programmatically triggering media downloads and extracting work details via external scripts. It includes a media asset manager that sorts downloaded content into custom folders using filename patterns based on author

ytdlnis is a mobile application that serves as a graphical client for the yt-dlp engine on Android. It functions as a media downloader and manager, providing a user interface to retrieve video and audio from websites. The project distinguishes itself by integrating directly with the Android system share menu and intents to trigger background downloads from external apps. It includes a dedicated authentication cookie manager to import and sync browser session data, enabling the retrieval of private, age-restricted, or premium content. The application covers broad capability areas including au

Agent-Reach is an AI agent web gateway and search tool that provides language models with the ability to search and read content from the open web, social media, and community forums without using official APIs. It functions as a routing layer that connects large language models to various internet backends while managing content parsing and connection health. The system enables API-free information retrieval by using open-source backends to extract text and metadata from platforms such as Twitter, Reddit, and YouTube. It converts unstructured website content, RSS feeds, and video transcripts

TikTokDownloader is a containerized automation tool designed for the systematic collection and archiving of social media content. It functions as an HTTP API-driven service that enables users to trigger automated media retrieval and metadata extraction tasks through standard web requests, facilitating the storage of videos, images, and platform data for offline analysis. The utility distinguishes itself through session-based web scraping, which utilizes browser cookies to authenticate requests and access restricted platform content that is otherwise unavailable. By maintaining active session

MeTube is a self-hosted, containerized media downloader that provides a web-based interface for archiving online video content. It functions as a manager for the command-line tool yt-dlp, automating the retrieval, organization, and post-processing of media files directly to your local hardware. The application distinguishes itself by supporting authenticated downloads, allowing users to inject browser-derived session cookies to access private or restricted content. It also features advanced post-processing capabilities, including the automatic embedding of metadata, chapter markers, and subti

This project is a command-line video downloader and web media extractor written in Python. It is designed to retrieve video and audio streams from various hosting platforms for local storage or real-time streaming via standard output. The system utilizes a framework of custom extractor classes to handle different websites and allows for the development of new extractors to extend compatibility. It supports accessing restricted, private, or region-locked content through the use of session cookies, user-agent headers, and proxy server routing. Capabilities include media format selection based

Toutatis is an open-source intelligence tool designed to extract public account information, emails, and phone numbers from Instagram profiles. It functions as a command-line utility for gathering user details and contact information for research purposes. The tool provides capabilities for public identity verification and account intelligence by translating usernames into internal unique identifiers to retrieve associated profile data. The system handles data extraction through a command line interface, utilizing request simulation and session-based API interactions to parse structured data

This project is a command-line media downloader designed for the systematic retrieval and organization of digital content from diverse online platforms. It functions as an extensible extraction engine that utilizes a declarative format-selection pipeline to automate the identification, merging, and downloading of specific audio and video streams based on user-defined criteria. The system distinguishes itself through a modular architecture that supports custom plugins and site-specific scripts, allowing for the bypass of platform restrictions and the handling of complex authentication challeng

snscrape is a Python-based social media web scraper and crawler designed to extract public posts, profiles, and hashtags from social networks without the use of official APIs. It functions as an archival tool and a utility for open-source intelligence data collection, allowing for the gathering of publicly available information to investigate trends and people. The tool facilitates social media data extraction for research and archival purposes, enabling the creation of historical records of conversations and user activity. It supports workflows for academic social analysis and the export of

This project is a Telegram API client and media archiving system designed to programmatically retrieve chat histories and export media. It functions as a download manager and message forwarder, allowing users to back up photos, videos, and documents from Telegram chats into structured local archives. The system distinguishes itself through advanced content filtering and forwarding capabilities. It can monitor chats for new messages, apply custom regular expressions to filter media by size or date, and automatically forward content between chats. This includes the ability to export protected c

Gallery-dl is a command-line utility designed for the automated retrieval and archiving of image collections from various hosting websites. It functions as a content scraper that manages the entire lifecycle of media discovery, from identifying assets on web pages to storing them in structured local directories. The tool utilizes a plugin-based architecture to handle site-specific extraction logic, allowing it to map input web addresses to the appropriate modules through pattern matching. Users can define custom naming patterns and directory structures using configuration-driven templates, en

PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer

Subfinder is a security reconnaissance framework designed for subdomain enumeration and attack surface management. It functions as a discovery engine that identifies and maps internet-exposed infrastructure, cloud-hosted assets, and network ranges to maintain a comprehensive inventory of an organization's digital footprint. The project distinguishes itself through a modular, template-driven scanning engine that executes security checks against discovered assets. It leverages cloud-native asset discovery to query provider APIs and infrastructure metadata, while supporting distributed agent orc

Grav is a flat-file content management system that eliminates the need for a traditional database by storing site content and configuration in human-readable Markdown and YAML files. Built as a modular PHP web framework, it uses a hierarchical page routing system where the physical directory structure directly determines the site's URL paths. The platform is distinguished by its event-driven plugin architecture and a command-line interface that prioritizes system administration, deployment, and maintenance tasks. It utilizes a blueprint-driven system to generate administrative forms from stru

ytDownloader is a video downloader and media extraction tool that uses the yt-dlp engine to retrieve video and audio files from various social media and video sharing platforms. It functions as a utility for capturing full media files, specific segments or ranges of tracks, and entire video playlists. The project includes a hardware-accelerated video compressor to reduce file sizes while maintaining visual quality. It also features a subtitle downloader capable of retrieving both text captions and embedded subtitle tracks for accessibility and translation. The system handles broad media task

Lux is a command line video downloader written in Go designed for extracting and saving video and audio from various websites. It functions as a concurrent media downloader that increases transfer speeds by splitting files into fragments and downloading them using multiple threads. The tool serves as a playlist download manager capable of retrieving entire video collections or specific ranges of items. It also operates as a proxy-enabled media client, supporting HTTP and SOCKS5 proxies and session cookies to access region-locked, private, or age-gated content. Additional capabilities include

This project is a digital library exporter and EPUB content generator specifically designed to download and convert books from the O'Reilly Learning platform into electronic publication files for offline reading and permanent storage. It functions as a web content scraper that retrieves restricted text and media to facilitate digital library archiving. The tool manages session authentication using credentials or cookies to maintain continuous access to content. It retrieves books via unique identifiers and transforms the source material into standardized EPUB files, including layout optimizat

PixivUtil2 is a digital content scraper and media downloader designed for the automated archiving of artwork and videos from Pixiv. It functions as a batch image archiver that retrieves posts based on member IDs, tags, or bookmarked collections. The software uses browser session cookies and user agents to authenticate accounts, enabling the retrieval of restricted or age-restricted material. It differentiates itself through the ability to synchronize bookmarked content and the use of external media tools to re-encode animated images and videos into different formats. The system manages large

This project is a RESTful media extraction service that provides a programmatic interface for downloading video and image content from social media platforms. It functions as a scraper that parses shared URLs and user profile identifiers to isolate direct media streams and associated metadata from platform-specific data structures. The service distinguishes itself through its ability to emulate cryptographic signatures and security tokens required to authenticate requests against protected backend services. By simulating headless browser behavior and managing cookies and headers, the system b

Parabolic is a graphical frontend for the yt-dlp engine, serving as a web media downloader and extractor. It provides a visual interface for saving high-quality video and audio content from various web platforms into local files. The application functions as a multi-format media exporter, allowing content to be saved into diverse audio and video containers. It includes a media metadata manager to capture and store associated information, such as subtitles and technical metadata, alongside the downloaded files. The system supports batch content acquisition through concurrent download manageme

Twikit is a Python library and API wrapper designed for interacting with X (Twitter). It simulates browser requests and mimics private network traffic to enable programmatic access to the platform without requiring an official API key. The project focuses on social media automation and data extraction, featuring tools for scraping user profiles, trending topics, and chronological tweet histories. It includes a session manager that handles user authentication, two-factor authentication, and cookie persistence to maintain active account access. The library's capabilities cover a broad range of

Annie is a command-line video downloader and web video extraction library written in Go. It functions as a concurrent media downloader designed to fetch video files and playlists from websites via URLs. The tool distinguishes itself through a proxy-aware network layer that supports SOCKS5 and HTTP proxies to bypass regional content restrictions. It also incorporates session cookie integration and referrer spoofing to facilitate the download of authenticated or age-gated content. The project provides capabilities for bulk media acquisition, including batch downloading from text files and extr

Nitter is a privacy-focused, alternative web interface for viewing public social media content. It functions as a server-side proxy that fetches and renders external posts, allowing users to browse content without requiring a personal account or executing third-party tracking scripts. By stripping away user identifiers and tracking mechanisms, the application provides a lightweight, anonymous viewing experience. The project distinguishes itself through its emphasis on network-level privacy and self-sovereignty. It supports routing traffic through Tor and I2P networks to bypass censorship and