CalebTracey / go-scraper

Web scraping API written in Golang for business data collection.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

go-scraper

build test

Web scraper written in Go. Intended to collect business data based on location.

go-colly used to scrape yellowpages for basic data.

Google geocode finds the longitude and latitude with scraped address.

Current available search parameters:

  • Search terms - "terms"*
  • "city"*
  • "state"*

*Required

Example request body:

Run configuration:


About

Web scraping API written in Golang for business data collection.


Languages

Language:Go 98.9%Language:Dockerfile 1.1%