A Flask boilerplate for scraping work. I searched web when I needed a scraping(scrapy) boilerplate but didn't find anything useful.So I decided to make a scraping starter project.
- User account sign up, sign in.
- Error handling.
- HTML macros and layout file.
- "Functional" file structure.
- Application factory.
- Static file bundling.
- Logging.
- Scraping
- Downloadable scraped data in csv,json,xls format
- task queue support, celery
- Database: Sqlite
- Web Framework: Flask
- Front End: MDL , Bootstrap
- javascript
- scrapy
- Gunicorn
- Nginx
- Supervisor
Install all dependency via
pip install -r requirements.txt
Follow the guide
Trying on local machine, just hit
python app.py
- Apoorv Raj Saxena
This project is licensed under the MIT License