Sadraw / RobotFileParser

Automated Python Script to Check if we are Allowed to Scrape a Particular Website

RobotFileParser

You Might need to install a few Libraries for the Script to Work

Automated Python Script to Check if we are Allowed to Scrape a Particular Website.

It is very easy to use. Just write the website you want to check out, and Voilà!

Enjoy!