"+http://www.google.com/bot.html" is not detected as crawler
meszaros-lajos-gyorgy opened this issue · comments
The following user agent strings seem to not be detected as a crawler:
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.5735.179 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
false alarm, my bad, the crawler detect works fine!