[86665] in North American Network Operators' Group
Paging Google's Googlebot developers re. bugs
daemon@ATHENA.MIT.EDU (Matthew Elvey)
Sun Nov 13 14:08:55 2005
Date: Sun, 13 Nov 2005 11:08:25 -0800
From: Matthew Elvey <matthew@elvey.com>
To: nanog@merit.edu
Errors-To: owner-nanog@merit.edu
Googlebot keeps ignoring my robots.txt file, thereby hammering the
server and facilitating spam.
I think I found at least 2 bugs; see this thread in the robots.txt forum
thread:
http://www.webmasterworld.com/forum93/782.htm
I've used Google's direct contact form last Wednesday; still no ack or
response.
Please don't reply w/o reading the above thread, to avoid repetition.
I'm looking for a fix, not a workaround (such as a temporary total
Googlebot ban).
