mahmoudgalal / scrapycrawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

scrapycrawler

ScrapingHub
ScrapingHub is a cloud based controller to the scrapy spider where you can start ,schedule the spider to run and inject data to the es server.To use it just login to the account at scrapinghub.com
username:mahmoudgalal
password:modeso
Once logged in you have full control over the spider
to add extra URLS to be crawled ,open the spider code (test_spider.py) in any text editor and add your url to the start_urls attribute

About


Languages

Language:Python 100.0%