jobsfan / Fast-picture-crawler

It`s a multiprocess crawler which crawl 360、baidu、google、bing、sogou、www.123rf.com and image.shutterstock.com.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Fast picture crawler base on keyword searching engine

what fast picture crawler can do

It`s a multiprocess crawler which crawl 360、baidu、google、bing、sogou、www.123rf.com and image.shutterstock.com.

how to use

You can start with the file "start_pic_main.py". Just replace the keyword_list and data_path with your own searching words and path then you will start this crawler.

The searching words can be in chinese or english, also you can try the other languages, I think it may work too.

If there is any problem in your pyppeteer, you can just comment the "pp_main" part.

About

It`s a multiprocess crawler which crawl 360、baidu、google、bing、sogou、www.123rf.com and image.shutterstock.com.


Languages

Language:Python 100.0%