nasir733 / pythonScrapperRelator

pythonScrapper

PythonScrapper By Devthinks.com

Create A Virtual Environment

python -m venv venv

windows (powershell)

.\venv\Scripts\activate

Mac/Linux

source venv/bin/activate

Install Dependencies from requirements.txt

pip install -r requirements.txt

Adjust the MAX_PAGE_SIZE Variable in the main.py file to the max number of pages you want to scrape

Run the scraper

python main.py