Feature
aali99 opened this issue · comments
i wish if there is an ability to control headers while crawling the site.
for example an "H" argument that we can control to set headers.
and thanks for the great tool:)
Try the -headers
flag, for more info use hakrawler --help