amazon-scrapy

Scrapy the detail and lowest price of amazon best seller product by python spider

In developing........, welcome to join !

Some code has apply to pricejot.com. https://www.pricejot.com/

Sorry for that I dont update the spider for long time. Some feature maybe have some bug now and the document is not so completely. Anyway Iam back and will fix it in the month !

How to install

install python3.6 pip install -r requirements.txt

if you are contributer recommend to php install pipreqs run "pipreqs /path/to/project" if you add some packages in your code

Source url

list page https://www.amazon.com/Best-Sellers/zgbs/ update every two hours.
price detail page https://www.amazon.com/gp/offer-listing/B01FCTAEK4

TODO

Scrapy the reviews by asin https://www.amazon.com/Libratone-ONE-Click-Caribbean-Green/product-reviews/B00ZU33BBC
Scrapy the detail by asin pool(50%)
Find the bad comment customer·s email and order id（considering to open source）

done

Scrapy the category of level 1 from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
Scrapy the asin in the best seller asin from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
Scrapy the keywords rank by asin