Spider for broken links
kgaughan opened this issue · comments
It might be useful to check older links occasionally for freshness, by doing a conditional GET/HEAD on them to ensure they're still around. Anything other than a 304 (or a 200 for some dynamically generated pages) should be flagged.
Some kind of report of their status might also be nice.