vemulasravan6 / scrapers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

scrapers

Basic Architecture :

Configs -Dir - Configs for respective

Seed Urls - u'll find an exclusive url for each category

Ex : -

http://www.lazada.sg/shop-mobiles/ For Lazada Mobiles

we need to mention these in config directory

Running Steps : - Install lxml [page parsing library] and requests using pip recommeded - run lazada.py and qoo10.py python source files and wait for a moment

Output: - You'll find scraped product information in data_dump dir.

Thats it.

About


Languages

Language:Python 100.0%