`fetchHost` doesn't follow redirects
przmv opened this issue · comments
Petr Razumov commented
I'm wondering about the decision of not following redirects with http.Client
within fetchHost
function: https://github.com/rverton/webanalyze/blob/master/webanalyze.go#L105
Following HTTP redirects is crucial for our use case.
What do you think about adding the ability to provide some custom http.Client
to NewWebAnalyzer
?
I'm going to submit a pull request to better describe the idea.
Robin Verton commented
Hi @pshevtsov,
following redirects often led to leaving the target scope/environment.
I'm open to make this more configurable if you need it.
Greetings
Petr Razumov commented