Dota Crawler
Please run:
sudo pip install virtualenv
virtualenv .crawler
source .crawler/bin/activate
pip install -r requirements.txt
scrapy runspider herocrawl.py
scrapy runspider itemcrawl.py
Crawler for dotapedia. Fills a Mongo and a PG database with game data.
Please run:
sudo pip install virtualenv
virtualenv .crawler
source .crawler/bin/activate
pip install -r requirements.txt
scrapy runspider herocrawl.py
scrapy runspider itemcrawl.py
Crawler for dotapedia. Fills a Mongo and a PG database with game data.