redarrowdev / slybot

Slybot web crawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Slybot crawler

Slybot is a Python web crawler for doing web scraping. It's implemented on top of the Scrapy web crawling framework and the Scrapely extraction library.

The documentation (including installation and usage) can be found at: http://slybot.readthedocs.org/

About

Slybot web crawler