Filter out bots

Question

Filter out bots

bendotero opened this issue 5 years ago · comments

Does the tracker record bots that are visiting the site? If so, is there a way to filter that out other than directly manipulating the DB?

Tobias Reich · Answer 1 · Thu Oct 10 2019 15:36:46 GMT+0800 (China Standard Time)

There's currently no logic in ackee-tracker to block bots. Do you know a way to detect them?

Michaël Fortin · Answer 2 · Tue Feb 11 2020 00:06:50 GMT+0800 (China Standard Time)

Could it be as simple as this to block most bots, or am I missing something? https://stackoverflow.com/a/20084661/167983

Without bot blocking analytics can get quite skewed.

Tobias Reich · Answer 3 · Tue Feb 11 2020 16:38:34 GMT+0800 (China Standard Time)

@fortinmike This could work. The crawler list is quite big so it would make sense to do this server-side using is-ua-bot. Or client-side with a smaller list that only contains important crawlers.

Yehuda B. · Answer 4 · Mon Oct 12 2020 03:36:05 GMT+0800 (China Standard Time)

@electerious
Looks like this is open for quite some time.

I thought I suggest my PR, which does the filtering on client-side, assuming that most bot that do run JS are also those that match the RegEx in the SO post linked by @fortinmike.

Tobias Reich · Answer 5 · Sun Oct 18 2020 17:16:18 GMT+0800 (China Standard Time)

Merged. Will be part of the next release!