[86765] in North American Network Operators' Group
Re: STILL Paging Google...
daemon@ATHENA.MIT.EDU (Niels Bakker)
Wed Nov 16 08:17:41 2005
Date: Wed, 16 Nov 2005 14:17:08 +0100
From: Niels Bakker <niels=nanog@bakker.net>
To: nanog@merit.edu
Mail-Followup-To: nanog@merit.edu
In-Reply-To: <437A83AC.8050805@elvey.com>
Errors-To: owner-nanog@merit.edu
* matthew@elvey.com (Matthew Elvey) [Wed 16 Nov 2005, 01:56 CET]:
>Still no word from google, or indication that there's anything wrong
>with the robots.txt. Google's estimated hit count is going slightly up,
>instead of way down.
robots.txt is about explicitly spidering your site; Google will still
follow links from outside towards your website and index pages linked
that way.
This is common knowledge
-- Niels.
--
"Calling religion a drug is an insult to drugs everywhere.
Religion is more like the placebo of the masses."
-- MeFi user boaz
