rverton / webanalyze

Port of Wappalyzer (uncovers technologies used on websites) to automate mass scanning.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`fetchHost` doesn't follow redirects

przmv opened this issue · comments

I'm wondering about the decision of not following redirects with http.Client within fetchHost function: https://github.com/rverton/webanalyze/blob/master/webanalyze.go#L105

Following HTTP redirects is crucial for our use case.

What do you think about adding the ability to provide some custom http.Client to NewWebAnalyzer?

I'm going to submit a pull request to better describe the idea.

Hi @pshevtsov,
following redirects often led to leaving the target scope/environment.

I'm open to make this more configurable if you need it.

Greetings