[8256] in www-talk@info.cern.ch
Re: Byte ranges (actually robots)
daemon@ATHENA.MIT.EDU (Darren New)
Thu May 25 16:20:18 1995
Date: Thu, 25 May 1995 15:46:33 +0500
Errors-To: procmaster@www19.w3.org
Reply-To: dnew@sgf.fv.com
From: Darren New <dnew@sgf.fv.com>
To: Multiple recipients of list <www-talk@www10.w3.org>
> and I can't just flag anyone who fetches robot.txt as a robot, since of
> course a person may fetch it too.
And of course not all robots will fetch robot.txt, either. Welcome to
the internet! :-)
