koolkt / crawler

Crawl a single website

Web crawler using asyncio coroutines

Install

$> git clone https://github.com/KKfo/crawler.git

Requires python 3.5 >=

$> pyvenv env
$> source env/bin/activate
$> pip install -r requirements/production.txt