oscardelben / rawler

Rawler is a tool that crawls the links of your website

Home Page:http://oscardelben.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Base tag is not taken into consideration

mariosant opened this issue · comments

I was rawling http://www.dermatix.gr and found that while there is a <base href="http://www.dermatix.gr" /> it was not taken into consideration when it tested <a href="ta-proionta-dermatix/">DERMATIX</a>.

The result was that it was looking for http://www.dermatix.gr/ta-proionta-dermatix/ta-proionta-dermatix which of course is wrong.