gosom/google-maps-scraper

Features

• Maps Data Extraction - Extracts business details and customer reviews from Google Maps for market research and analysis.
• Business Scrapers - Extracts comprehensive business details, reviews, and lead information from Google Maps search results.
• Lead Extraction - Automates the collection of company contact details and emails from Google Maps for lead generation.
• Email Address Extraction - Automatically identifies and collects email addresses by recursively crawling business websites.
• Distributed Task Coordination - Coordinates distributed scraping tasks across multiple instances using a shared database to prevent race conditions.
• Task Distribution Scaling - Scales data collection by distributing scraping tasks across multiple workers and pods.
• Traffic Routing Proxies - Routes outbound scraping traffic through SOCKS5, HTTP, and HTTPS proxies to avoid IP blocking.
• Proxy Routing - Routes outbound requests through SOCKS5 and HTTP proxies to avoid IP blocking during scraping.
• Scraping Architectures - Implements a scalable architecture designed to coordinate high-volume data extraction across distributed server networks.
• Web Scraping - Functions as a distributed engine for extracting structured business information from websites and map services.
• Serverless Functions - Deploys scraping logic as serverless functions to run data extraction tasks on-demand.
• Customer Review Extraction - Gathers comprehensive sets of customer reviews, including text, ratings, and timestamps, from map listings.
• Serverless Processing - Processes business data using on-demand serverless compute functions without managing underlying infrastructure.
• Geospatial Search - Implements high-speed business data retrieval using specific geographical coordinates and radius parameters.
• Custom Data Format Plugins - Provides a plugin system to implement read/write logic for proprietary data export formats.
• Multi-Format Data Exports - Allows exporting extracted business information into multiple structured formats including CSV and JSON.
• Serverless Function Management - Supports executing scraping tasks as on-demand serverless functions to eliminate permanent server management.
• Radius Searches - Implements coordinate-based radius searches to optimize the retrieval of business data from maps.
• Data Export Adapters - Ships a modular adapter system to route extracted business data to various external storage targets.
• Website Crawlers and Scrapers - Includes a recursive crawler that navigates business websites to extract contact email addresses.

Star history