patriciabonaldy / webcrawler

web crawle made in Go

webcrawler

webcrawle is an app to scrape sites, write in Go

How to install:

Execute the following command:

make setup

How to use:

You have to execute the webcrawler binary, passing the "-u" or "url" flag

Note : if you need help, running the command with the "-" flag

./webcrawler -u your_url_to_scrape

---

Testing

make tests