Now that we can make our own robots.txt as a system message, wikis wanting to start one will want to know what is already there (since it overrides the "real" one), so we are not changing things which shouldn't be changed. Is robots.txt available on noc or somewhere else?
As well, can we add a bare-bones robots.txt to SVN as a place to start? (shouldn't take effect unless the system message exists though)
Mike
2008/9/15 [email protected]:
Now that we can make our own robots.txt as a system message, wikis wanting to start one will want to know what is already there (since it overrides the "real" one), so we are not changing things which shouldn't be changed. Is robots.txt available on noc or somewhere else?
Well, if you take into account how that thing works, it should be available at http://en.wikipedia.org/robots.txt shouldn't it? ;-)
There is also some high-level information at http://www.mediawiki.org/wiki/Robots.txt
-- [[cs:User:Mormegil | Petr Kadlec]]