IAmStoxe / urlgrab

A golang utility to spider through a website searching for additional links.

IAmStoxe/urlgrab Issues

License?
Updated 3 years ago
Getting Error [Page Collector] Max Depth Reached
Updated 4 years ago1
go get error (unrecongnized import path)
Updated 4 years ago1
Cookie Support
Updated 4 years ago2
unexpected module path "urlgrab"
Updated 4 years ago
Feature Request: Pause and Resume functionality for urlgrab
Updated 4 years ago1
Add ability to customize scraped link regex pattern.
Closed 4 years ago1
Add ability to specify a specific user-agent
Closed 4 years ago
Find a way to output information more concisely.
Closed 4 years ago1
Update README to reflect all options available
Closed 4 years ago
Add option to reduce verbosity
Closed 4 years ago
Add ability to ignore ssl certificates.
Closed 4 years ago1
Prevent urls containing our domain from being accepted/
Closed 4 years ago1
Add JS file parsing for additional links
Closed 4 years ago1
Create output options
Closed 4 years ago
Add socks5 proxy capabilities
Closed 4 years ago