niklak / tornado_spider

This is an example of web-spider with concurrent workers.

tornado web spider

This is an example of web-spider with concurrent workers using tornado http-client and event loop.

This example requires:

1. python 3.4;
2. tornado;
3. lxml;
4. beautifulSoup (4);