searchspider
- This is the version which will scrape medium for articles.
TODO
1. Add an simple api for the running the scraper with a simple call
2. Connect the store to a MongoDB or a Amzon data instance for easy collection
3. Deploy the scraper on Heroku for easy access
4. Setup scrapyd for the stats and maintainance