crawly This is a simple web crawler exercise written in Go. It really crawls the web! Can be used like this: $ crawly --concurrency 10 --start-at https://www.dropbox.com/ In action: (sorry dropbox pls no hate)
