[Referrer-Domain] Microsoft Search Engine Spiders are blocked!
HKPhysicist opened this issue · comments
My sites have joined MS Clarity and MS search spiders began to crawl my sites frequently. nginxrepeatoffender began to jail their IPs.
Their general domain names are:
msnbot-xxx-xxx-xxx-xxx.search.msn.com
How do I whitelist them? In where xxx-xxx-xxx-xxx is a general IPv4 IP address.