sanjaybip / basic-web-scraper

Basic web scraper in Golang

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Basic web scraper using Golang(Go)

We build a very basic web scraper in Go to scrap data from different website based on CSS selector.

Package used

  • github.com/gocolly/colly
  • github.com/go-co-op/gocron

We build a web scraper that scraps books title and price from books.toscrape.com. It navigate to all pages and extract the relevent information using css selectors. We also used a scheduler which is set to run the scraper at a specified time interval.

About

Basic web scraper in Golang


Languages

Language:Go 100.0%