kophy / stackoverflow-spider

A toy spider to play with Scrapy and MongoDB.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

stackoverflow-crawler

A toy web crawler to play with Scrapy and MongoDB.

Basically just followed this tutorial.

1. Run Spider

cd stack  
scrapy crawl stack

2. View Record in MongoDB

mongo
use stackoverflow
db.questions.find()

About

A toy spider to play with Scrapy and MongoDB.

License:MIT License


Languages

Language:Python 100.0%