A dumb site crawler to highlight broken links and faulty routes.
Searches for href attributes in HTML content and follows any links on the
same domain. Reports the HTTP status code, content length and request duration
of all crawled URLs.
$ ./spodermen https://github.com/cavaliercoder/spodermen
GET /cavaliercoder/spodermen 200 48600 1538
Dolan, y u do dis?
Terrible. Don't use it.
- Ryan Armstrong