Louisblack / sitemap-crawler

A crawler that checks for 404s in a sitemap

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

sitemap-crawler

The site I was working on has a generated site map. The way that the site map is generated means that there is a chance some pages are missing.

Because writing code is much more fun than manually checking each page I hacked together this module.

I'll hopefully spend some time cleaning it up, adding tests, linting and a CLI at some point...

To do

  • Make testable
  • Proper output - don't use console
  • Tests
  • Stricter linting

About

A crawler that checks for 404s in a sitemap


Languages

Language:JavaScript 100.0%