mcdxn / gau

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

getallurls (gau)

getallurls (gau) fetches known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl for any given domain. Inspired by Tomnomnom's waybackurls.

Resources

• Usage
• Installation

Usage:

Examples:

$ printf example.com | gau
$ cat domains.txt | gau
$ gau example.com

To display the help for the tool use the -h flag:

$ gau example.com -h

Flag	Description	Example
-providers	providers to fetch urls from	gau -providers wayback example.com
-retries	amount of retries for http client	gau -retries 7 example.com
-subs	include subdomains of target domain	gau -subs example.com

Installation:

From source:

$ GO111MODULE=on go get -u -v github.com/lc/gau

From binary:

You can download the pre-built binaries from the releases page and then move them into your $PATH.

$ tar xvf gau_1.0.1_linux_amd64.tar.gz
$ mv gau /usr/bin/gau

ohmyzsh note:

ohmyzsh's git plugin has an alias which maps gau to the git add --update command. This is problematic, causing a binary conflict between this tool "gau" and the zsh plugin alias "gau" (git add --update). There is currently a few workarounds which can be found in this Github issue.

Useful?