unable to crawl below sites error 404/403

[covertshell]

below are the website i have tried recently to crawl with whatweb but wasn't able to successfully crawl i get error 404 and 403. However if i do curl i get the full response.

URLs

hxxp://vidaychia.com/secured/auth/index.htm
hxxps://urlscan.io/result/a0d18567-de67-4fa4-bcc6-d9ddbc4b2d3c

hxxp://tuntunkids.com/secured/index.htm
hxxps://urlscan.io/result/3102eb43-d963-4d91-944c-7f5bac8e2c6d

[bcoles]

Perhaps they're blocking WhatWeb. Try changing the user-agent string with --user-agent.

[covertshell]

Thanks it did work! :)