niklak / aiohttp_spider

An example of web spider using aiohttp

aiohttp_spider

This is an example of web-spider with concurrent workers using aiohttp session client and asyncio event loop. Also there is an example of concurrent file downloader.

Web-spider example requires:

1. python 3.5;
2. aiohttp;
3. lxml;
4. beautifulSoup (4);

Downloader example requires:

1. python 3.5;
2. aiohttp;