mou55 / gplus_spider

Highly js based google plus is crawled with scrapy+selenium+phantomjs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

gplus_spider

Highly js based google plus is crawled with scrapy+selenium+phantomjs

you have to install 2 tools to work this plus spider which will work perfectly with js featers of google plus.

1)selenium package for python pip install selenium 2)phantomjs sudo apt-get install phantomjs or http://phantomjs.org/download.html nd map the phantomjs bin path in line 27 of pspider.py 3)ghostdriver ghost driver is a must tool to work this spider perfect

About

Highly js based google plus is crawled with scrapy+selenium+phantomjs


Languages

Language:Python 99.7%Language:Shell 0.3%