# gosom/google-maps-scraper

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/gosom-google-maps-scraper).**

3,192 stars · 433 forks · Go · mit

## Links

- GitHub: https://github.com/gosom/google-maps-scraper
- awesome-repositories: https://awesome-repositories.com/repository/gosom-google-maps-scraper.md

## Topics

`distributed-scraper` `distributed-scraping` `golang` `google-maps` `google-maps-scraping` `web-scraper` `web-scraping`

## Description

This project is a distributed scraping engine designed to extract business details, customer reviews, and lead information from Google Maps. It functions as a business scraper and data extractor that can be deployed as a permanent system or as on-demand serverless functions.

The system utilizes a proxy-routed web crawler to manage request origins via SOCKS5, HTTP, and HTTPS proxies. To locate contact information, it includes an email extraction tool that recursively crawls business websites linked within map listings.

The software supports coordinate-based radius searches for efficient data retrieval and synchronizes scraping jobs across multiple machines or pods using a shared database. Extracted data can be saved through a plugin-based system into CSV, JSON, or other external database formats.

## Tags

### Business & Productivity Software

- [Maps Data Extraction](https://awesome-repositories.com/f/business-productivity-software/maps-data-extraction.md) — Extracts business details and customer reviews from Google Maps for market research and analysis.
- [Business Scrapers](https://awesome-repositories.com/f/business-productivity-software/business-scrapers.md) — Extracts comprehensive business details, reviews, and lead information from Google Maps search results.
- [Lead Extraction](https://awesome-repositories.com/f/business-productivity-software/lead-management/lead-extraction.md) — Automates the collection of company contact details and emails from Google Maps for lead generation.
- [Customer Review Extraction](https://awesome-repositories.com/f/business-productivity-software/customer-review-extraction.md) — Gathers comprehensive sets of customer reviews, including text, ratings, and timestamps, from map listings. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))

### Data & Databases

- [Email Address Extraction](https://awesome-repositories.com/f/data-databases/url-crawl-queues/url-extraction/email-address-extraction.md) — Automatically identifies and collects email addresses by recursively crawling business websites. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))
- [Serverless Processing](https://awesome-repositories.com/f/data-databases/data-processing-pipelines/stream-processing-systems/stream-processing/serverless-processing.md) — Processes business data using on-demand serverless compute functions without managing underlying infrastructure.
- [Geospatial Search](https://awesome-repositories.com/f/data-databases/search-indexing/geospatial-search.md) — Implements high-speed business data retrieval using specific geographical coordinates and radius parameters. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))

### DevOps & Infrastructure

- [Distributed Task Coordination](https://awesome-repositories.com/f/devops-infrastructure/distributed-lock-coordination/distributed-task-coordination.md) — Coordinates distributed scraping tasks across multiple instances using a shared database to prevent race conditions.
- [Task Distribution Scaling](https://awesome-repositories.com/f/devops-infrastructure/worker-scaling/task-distribution-scaling.md) — Scales data collection by distributing scraping tasks across multiple workers and pods. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))
- [Serverless Function Management](https://awesome-repositories.com/f/devops-infrastructure/serverless-function-management.md) — Supports executing scraping tasks as on-demand serverless functions to eliminate permanent server management. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))

### Networking & Communication

- [Traffic Routing Proxies](https://awesome-repositories.com/f/networking-communication/network-infrastructure-routing/network-infrastructure-configuration/network-infrastructure/traffic-routing-proxies.md) — Routes outbound scraping traffic through SOCKS5, HTTP, and HTTPS proxies to avoid IP blocking. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))
- [Proxy Routing](https://awesome-repositories.com/f/networking-communication/request-proxies/proxy-routing.md) — Routes outbound requests through SOCKS5 and HTTP proxies to avoid IP blocking during scraping.

### Software Engineering & Architecture

- [Scraping Architectures](https://awesome-repositories.com/f/software-engineering-architecture/distributed-systems-architectures/scraping-architectures.md) — Implements a scalable architecture designed to coordinate high-volume data extraction across distributed server networks.
- [Data Export Adapters](https://awesome-repositories.com/f/software-engineering-architecture/software-architecture/architectural-patterns/plugin-module-systems/modular-plugin-architectures/plugin-based-architectures/event-export-plugins/data-export-adapters.md) — Ships a modular adapter system to route extracted business data to various external storage targets.

### Web Development

- [Web Scraping](https://awesome-repositories.com/f/web-development/web-automation-scraping/web-scraping-automation/web-scraping.md) — Functions as a distributed engine for extracting structured business information from websites and map services.
- [Website Crawlers and Scrapers](https://awesome-repositories.com/f/web-development/website-crawlers-and-scrapers.md) — Includes a recursive crawler that navigates business websites to extract contact email addresses.

### Part of an Awesome List

- [Serverless Functions](https://awesome-repositories.com/f/awesome-lists/devops/serverless-functions.md) — Deploys scraping logic as serverless functions to run data extraction tasks on-demand.

### Development Tools & Productivity

- [Custom Data Format Plugins](https://awesome-repositories.com/f/development-tools-productivity/custom-data-format-plugins.md) — Provides a plugin system to implement read/write logic for proprietary data export formats. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))
- [Multi-Format Data Exports](https://awesome-repositories.com/f/development-tools-productivity/multi-format-data-exports.md) — Allows exporting extracted business information into multiple structured formats including CSV and JSON. ([source](https://cdn.jsdelivr.net/gh/gosom/google-maps-scraper@main/README.md))

### Scientific & Mathematical Computing

- [Radius Searches](https://awesome-repositories.com/f/scientific-mathematical-computing/distance-metrics/spherical-distance-calculators/coordinate-distance-calculation/radius-searches.md) — Implements coordinate-based radius searches to optimize the retrieval of business data from maps.