Giters

mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[User-Agent] (AI Search Crawlers)

jlarmstrongiv opened this issue · comments

commented

Paste the full User-Agent String here

Amazonbot
Applebot
PerplexityBot
YouBot
Amazonbot

Is this for Addition / Removal?

  • Addition
  • Removal
  • Keep a watch on this one

Did the User-Agent request robots.txt first?

  • Yes
  • No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)


Post log excerpt here (paste in between the ```     ``` markers)

Additional information

They should be watched, but they cite websites so may be okay for now

See also https://darkvisitors.com/agents

commented

Will scan some logs for these