There exists many cases for crawling some websites, but there are not enough ip proxies to use, so i maintain the repo to keep track of a fresh and usable proxies list.
Going to keep it pretty basic, and use this as an excuse to get familiar with Flask.
- Flask
- Redis
- Gevent
- Supervisor
That's basically it!
Please note: this is a work in progress.