CVS commit: htdocs

[David Maxwell <david%netbsd.org@localhost>]

Module Name:    htdocs
Committed By:   david
Date:           Tue Jan 15 15:28:45 UTC 2008

Modified Files:
        htdocs: robots.txt

Log Message:
Ask Google not to index xml (source) files, because returning them as
search results is bad for users.

Note - a wildcard in the disallow statement is not valid robots.txt
usage, but Google supports it anyway.


To generate a diff of this commit:
cvs rdiff -r1.1 -r1.2 htdocs/robots.txt

Please note that diffs are not public domain; they are subject to the
copyright notices on the relevant files.