Giters

mitchellkrogza / nginx-ultimate-bad-bot-blocker

Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[User-Agent] Bytespider, Bytedance didn't get to block after install bad bot blocker

dicky-yuen opened this issue · comments

commented

Paste the full User-Agent String here

Bytespider
Bytedance

Is this for Addition / Removal?

  • Addition
  • Removal
  • Keep a watch on this one

Did the User-Agent request robots.txt first?

  • Yes
  • No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

"-" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)"

Additional information

Anyone are able to block this crawler?