xieyunzi / scrapy-spiders

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

python3 needed

install & run

git clone <this-repo>
pip3 install -r requirements.txt
# setup mongodb, configure `./feeds/settings.py`
# show spiders, etc. alexa and more
scrapy list
# run it
scrapy crawl alexa

About


Languages

Language:Python 100.0%