khoben / webscrapper

Web scraper that can handle dynamically loaded or static content

ContentWebScrapper

Generic web scraper BASE : https://github.com/naderalexan/generic_scrapper

Python Version

Python 3.6

Installation

1. Put scraper.py and requirements.txt in your project directory
2. Cd into the project directory
3. Create a virualenv virtualenv env -p python3
4. Activate environment source env/bin/activate
5. Install requriments pip install -r requirments.txt
6. Download and Add chromedriver to your path (https://sites.google.com/a/chromium.org/chromedriver/)

Usage