web-crawler-examples
commands
# start project
scrapy startproject myproject
# crawl and save to json
scrapy crawl myspider -o out.json
# scrapy shell
scrapy shell 'https://example.com'
# >>> response.xxx
# start project
scrapy startproject myproject
# crawl and save to json
scrapy crawl myspider -o out.json
# scrapy shell
scrapy shell 'https://example.com'
# >>> response.xxx