codesplicer / crawler

Concurrent sitecrawler implemented in Go

Web Crawler

Crawls a site and produces a sitemap of internal links

Usage

make build # Uses godep to install all dependencies to vendor/ ./bin/crawler https://monzo.com

Testing

make test

Author

• Vik Bhatti [e-mail]