1 repo
Specialized scrapers for collecting public content and metadata from social media platforms.
Distinguishing note: Focuses on social media specific extraction, distinct from general web scraping.
Explore 1 awesome GitHub repository matching web development · Social Media Extraction Tools. Refine with filters or upvote what's useful.
MediaCrawler is an automated web scraping framework designed to extract public posts, comments, and creator metadata from various social media platforms. It functions as a headless browser automator, utilizing real browser instances to render dynamic content and execute the client-side scripts necessary for interacting with modern web interfaces. The system distinguishes itself through a focus on session persistence and network flexibility. It supports remote debugging to reuse active browser sessions and cookies, which helps minimize the risk of triggering platform security challenges. To ma
Extracts public posts, comments, and creator metadata from various social platforms.