Cool robots.txt pages
Inspired by this HackerNews Thread
- Nike - https://www.nike.com/robots.txt
- YouTube - https://www.youtube.com/robots.txt
- TripAdvisor - https://www.tripadvisor.com/robots.txt
- LastFM - https://www.last.fm/robots.txt (Read last three lines)
- Cloudflare - https://www.cloudflare.com/robots.txt
- Checkbot - https://www.checkbot.io/robots.txt