JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

Home Page:https://crawlerdetect.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Missing bot detection for prerender.io's crawler

LinusGeffarth opened this issue · comments

commented

I'm more confident this time b/c the web demo doesn't detect the following as a bot, even though it is:

Prerender

... from prerender.io.
The web demo does detect the full user-agent because of "GitHub" and probably "HeadlessChrome":

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/71.0.3578.98 Safari/537.36 Prerender (+https://github.com/prerender/prerender)

... but I figured it might be useful to also check for "Prerender" itself, in case the rest of the user-agent changes over time.

Would you like to create a PR to add this bot!?

Thanks 👍

Fixed in #441