krishnanvignesh / web_scraper_using_selenium

A scraper to scrape details abount plants and pests from www.agriculture.gov.au

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

website_scraper

scrape some data into an excel sheet.

scraper.py

run this file to generate the initial_pest.csv file and download all the subpage as html to downloads folder

parser.py

run this file parse all the downloaded html and extract content to final_pest.csv

Note:

  1. You need to have chrome version 74 installed as the web driver installed needs version 74 of chrome

  2. this code will work on windows only

Result:

Excel - final_pest.csv

About

A scraper to scrape details abount plants and pests from www.agriculture.gov.au


Languages

Language:HTML 99.8%Language:Python 0.2%