A lot of /query results are indexed by search engines
charettes opened this issue · comments
When searching for site:code.djangoproject.com to work around Trac search limitations a lot of useless queries show up as results
https://www.google.com/search?q=site%3Acode.djangoproject.com+%22_binary%22+select+mysql
I'm not sure Trac offers a way to disallow indexing of some pages but one solution could be to configure the proxy in front of it to point the /robot.txt path to a file defined in this repository with a Disallow: /query entry.
FWIW it looks like a misconfiguration of the proxy server as this repository includes an appropriate robots.txt file
While the one in place simply disallows /admin https://code.djangoproject.com/robots.txt
This has been fixed https://code.djangoproject.com/robots.txt