This project utilizes the Scrapy framework to scrape amazon for data. Currently, it retrieves laptop data(name, price and discount). However you can configure this as needed.
Database: Postgres DB
Server: Python, Scrapy
Clone the project
git clone https://github.com/KenMwaura1/py-amazon-scraper
Go to the project directory
cd py_amazon_scraper
Install dependencies
pip Install -r requirements
Change into the project directory
cd amz_scraper
Start the spider
scrapy crawl amznspider
If you have any feedback, please reach out to me at kemwaura@gmail.com