pkgsrc-Users archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

wip server struggling

In case anyone was wondering, the wip server is currently being
crawled by bing and is not handling it very well.

I modified the gitweb cgi file to change the robots <meta> tag to
"none" since I can't figure out a way for bozo to serve up a
robots.txt file in the current setup.

Anyway it will keep crawling until it's done but I'm hoping that it
eventually stops.

If things don't get better soon I will block the msn ip address.

Home | Main Index | Thread Index | Old Index