Zach-Leo / pexels-crawler

The web crawler for pexels

Pexels-Crawler

Pexels-Crawler is a efficient web crawler to get pictures from the PEXELS . It is totally handcarfted, with love.

NOTICE:

This project is deprecated, PEXELS provides convenient api for user to search pictures. Please refer to their official website for more information.

Installation

Get pexels-crawler from GitHub. There are several variants to do it:

Download latest master branch.

$ git clone https://github.com/Zach-Leo/pexels-crawler

Clone command will give you the whole repository.

Configuration

pexels-crawler comes with few configurations.

   $ vim config.yaml

#Http Header (for the most time, you don't need to change it)
user_agent: 'Mozilla/5.0 AppleWebKit/537.36 Chrome/65.0.3325.181 Safari/537.36'

#Where you want to download
download_dir: '/users/haohao/Desktop/pexels/'

#The content you need
element: 'cat'

#The number of pages you want to get
search_range: 20

Usage

$ python crawler.py

Contributing

Contribution is welcome, feel free to open an issue and fork. Waiting for your pull request.