i-am-naveen-m-j / check-url

Small script to check if URL is valid or not.

URL Checker 👀

A simple bash script to check if a URL is valid or not.

How to install 🔼

You don't have to install anything, this is just a plain bash script. However you are able to get it using git clone:

foo@bar:~$ git clone [e-mail]:herczogzoltan/url-checker.git

How to use

The script echoes the error message and the url checked into the standard output. Also when an error occurs, it saves the URL into a file called invalid_urls.txt.

Check single URL

✅ OK responses (HTTP status code 200-299):

foo@bar:~$ ./check-url.sh https://github.com
Checking https://github.com ..
✅ OK status code: $status_code for domain $URL

⚠️ WARNING responses (HTTP status code 300-399):

foo@bar:~$ ./check-url.sh http://google.com
Checking http://google.com ..
⚠️ Warning - Redirection - code: 301 for URL: http://google.com

⛔ Error responses:

foo@bar:~$ ./check-url.sh https://github.com/i-am-a-404
Checking https://github.com/i-am-a-404 ..
⛔ Error status code: 404 for URL: https://github.com/i-am-a-404

Check multiple URLs from file source

foo@bar:~$ cat example-urls.txt | xargs -n 1 ./check-url.sh
Checking https://google.com ..
⚠️ Warning - Redirection - code: 301 for URL: https://google.com
Checking https://github.com ..
✅ OK status code: 200 for domain https://github.com
Checking https://invalidurl-asdf1234.com ..
⛔ Error status code: 000 for URL: https://invalidurl-asdf1234.com

Run in parallel mode using lines of files

foo@bar:~$ cat example-urls.txt | xargs -n 1 -P 4 ./check-url.sh
Checking https://google.com ..
Checking https://github.com ..
Checking https://invalidurl-asdf1234.com ..
⛔ Error status code: 000 for URL: https://invalidurl-asdf1234.com
⚠️ Warning - Redirection - code: 301 for URL: https://google.com
✅ OK status code: 200 for domain https://github.com

Modify -P flag in the above example according to your needs and resources