This is a basic Django application for Wagtail to manage robots.txt files following the robots exclusion protocol, complementing the Django Sitemap contrib app.
This started as a fork of Django Robots but because of the differences between the Django Admin and the Wagtail Admin, and other project requirements git history has not been retained.
For installation and configuration instructions, check out the docs.