technomaniac / asyncrawl

Python 3.4 Asyncio Based Crawler

asyncrawl

Python 3.4 Asyncio Based Crawler

Usage

1. git clone https://github.com/technomaniac/asyncrawl.git
2. cd asyncrawl
3. pip3 install -r requirements.txt
4. python crawl.py -u "url" -c "max_tasks" -f "out csv file"