[159673] in North American Network Operators' Group
Re: Intermittent incorrect DNS resolution?
daemon@ATHENA.MIT.EDU (Damian Menscher)
Thu Jan 17 13:58:57 2013
In-Reply-To: <1358395779.36916797@apps.rackspace.com>
From: Damian Menscher <damian@google.com>
Date: Thu, 17 Jan 2013 10:58:21 -0800
To: Erik Levinson <erik.levinson@uberflip.com>
Cc: NANOG mailing list <nanog@nanog.org>
Errors-To: nanog-bounces+nanog.discuss=bloom-picayune.mit.edu@nanog.org
On Wed, Jan 16, 2013 at 8:09 PM, Erik Levinson
<erik.levinson@uberflip.com>wrote:
> To give an idea of the scale of the problem right now, I'm getting
> thousands of requests per minute to a new IP vs. about two requests per
> minute on the equivalent old IP, with over 60% of the latter being Baidu,
> but also a bit of Googlebot and other random bot and non-bot UAs.
>
It's common for malware to spoof the Googlebot user-agent since they know
most webmasters won't block it. You might want to check whether the IPs
you're seeing it from are really allocated to us -- if so, I'd be
interested in tracking down why we're crawling your old IP.
Damian