techperfect / scrapy_jingdong

用scrapy写的京东爬虫

scrapy crawl test -s JOBDIR=data -0 items.csv

watch -n 1 -d 'wc -l items.csv;du -h items.csv'

附数据 items.csv

http://hackerxu.com/2014/09/07/scrapy-jd.html