MyMusicTaste / boxoffice

base crawler for boxoffice

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

crawler-boxoffice

base crawler for boxoffice

#refer to scrapy official doc http://doc.scrapy.org/en/1.0/intro/tutorial.html#crawling

#TODO:

  • normalize, date, ateend/capacity, shows/sellout, prices, promoters for relational DB
  • switch to django or flask project

#pip req pip install scrapy

#command reference scrapy crawl bo

scrapy crawl bospider -o items.json

About

base crawler for boxoffice


Languages

Language:Python 100.0%