m11m / goclone

(Incomplete) Website Cloner - Utilizes powerful go routines to clone websites to your computer within seconds.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

jedi

Copy websites to your computer! goclone is a utility that allows you to download a website from the Internet to a local directory. Get html, css, js, images, and other files from the server to your computer. goclone arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link as if you were viewing it online.


Official Website


gitmoji-changelog


Example

Table of Contents

πŸš€ Installation

Brew

# tap
brew tap imthaghost/goclone
# install tool
brew install goclone

Manual

# go get :)
go get https://github.com/imthaghost/goclone
# change to project directory using your GOPATH
cd $GOPATH/src/github.com/imthaghost/goclone
# build and install application
go install

Todo

Short term

  • Clone top level site only
  • Update command line interface with Cobra
  • Clone all pages with given domain
  • Clone site that sits behind authentication wall
  • Update scraper for better performance

Long term

  • User specified depth of clone
  • Support both OSX and Linux (potentially Windows as well)

Examples

# goclone <url>
goclone https://dribbble.com

Dribbble

πŸ“ License

By contributing, you agree that your contributions will be licensed under its MIT License.

In short, when you submit code changes, your submissions are understood to be under the same MIT License that covers the project. Feel free to contact the maintainers if that's a concern.

Contributors

Contributions are welcome! Please see Contributing Guide for more details.

Gary Frederick
Tha Ghost

πŸ’»
Ben Lafferty
Ben Lafferty

πŸ’»

About

(Incomplete) Website Cloner - Utilizes powerful go routines to clone websites to your computer within seconds.

License:MIT License


Languages

Language:Go 100.0%