Go Download Web
A simple command-line application to download an entire online website, including CSS, JSS, and other assets. Coded with Go.
Project status
There are still some to-do's, and some refactoring is needed, but the app is already functional.
Installation
There is nothing special to do here, just download the code, build it as you would do with any other Go app, and you are set to go.
$ git clone https://github.com/antsanchez/go-download-web
$ cd go-download-web
$ go buildUsage
# Default mode:
$ ./go-download-web -u https://example.com
# Setting the number of concurrent connections to 10:
$ ./go-download-web -u https://example.com -s 10
# Scrape a website without ignoring query params on URLs
$ ./go-download-web -u https://example.com -q
# Change the domain name of the downloaded copy:
$ ./go-download-web -u https://example.com -new https://newname.comContributing
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.