JayBizzle / Crawler-Detect

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

Home Page:https://crawlerdetect.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Empty user agent

SoranDK opened this issue · comments

I see that my web-server-provider has a statistics section about bots and that they also identify visits with empty user-agent as bots.

Is it worth checking for this before running the exclude?

Their stats say 513 visits of that type on my site this year.

Can we safely say an empty user-agent is a bot? 🤔

That is a good question... I don't have an answer...

We probably don't know all browsers or user configurations so the rules are our best guesses and will probably always have an amount of both false positives and negatives... Can we safely say that all user-agents containing "reader" is one?

I would just suggest that there are perhaps not many ordinary user with a setup showing no user agents at all.

But I am new to this plugin so I will gladly yield to those with more experience to evaluate if that would result in an unreasonable amount of false positives :-)