The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Repository from Github https://github.comjpswade/robotstxtRepository from Github https://github.comjpswade/robotstxt
