Scrape-Steelobrien
Upwork Job
This is for scrape website with multi level link.
The feature not contain pagination. So if there is a pagination, please add it on check_url_status().
If possible create a file to safe total page, make no need to repeated run check_url_status().