laluka / crawlz

crawlz

crawlz

Crawlz, a best-effort approach for exhaustive website crawling ! 🌹

Install

# https://go.dev/doc/install
go get -v github.com/laluka/crawlz

Dev & Release

VER=v0.0.3
COMMIT="last change is..."
git add .
git status
git commit -m "$COMMIT"
git push
git tag "$VER"
git push origin "$VER"

Kudos

• Code structure highly inspired by https://github.com/hakluke/hakrawler
• Rework of my own python crawlz in progress :)