[86681] in North American Network Operators' Group
Re: Paging Google's Googlebot developers re. bugs
daemon@ATHENA.MIT.EDU (Jeff Rosowski)
Mon Nov 14 12:27:03 2005
Date: Mon, 14 Nov 2005 09:26:35 -0800 (PST)
From: Jeff Rosowski <rosowskij@ie.ymp.gov>
To: Matthew Elvey <matthew@elvey.com>
Cc: nanog@merit.edu
In-Reply-To: <43778F29.3090600@elvey.com>
Errors-To: owner-nanog@merit.edu
> Googlebot keeps ignoring my robots.txt file, thereby hammering the server and
> facilitating spam.
>
> I think I found at least 2 bugs; see this thread in the robots.txt forum
> thread:
> http://www.webmasterworld.com/forum93/782.htm
>
> I've used Google's direct contact form last Wednesday; still no ack or
> response.
>
> Please don't reply w/o reading the above thread, to avoid repetition.
> I'm looking for a fix, not a workaround (such as a temporary total Googlebot
> ban).
Requires you to register to read it. Sorry.