gbiankatf / web-scraping-parallel-processing

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Speeding Up Web Scraping with Parallel Processing

Run Initial Scraper:

$ python3 script.py

Run Parallel Scraper:

$ python3 script_parallel.py

Run Tests:

$ pytest

About


Languages

Language:HTML 79.2%Language:Python 20.8%