eqfinney / web-scraping

Breadth-first search based web crawler for HTML scraping. The code is written using Python's asyncio module to make it faster and more generalizable than a previous synchronous version.