[3556] in WWW Security List Archive
RE: Alta Vista may or may not harvest unadvertised documents
daemon@ATHENA.MIT.EDU (=?iso-8859-1?Q?=22A=2E_=D6mer_K=F6)
Fri Nov 15 17:38:49 1996
From: =?iso-8859-1?Q?=22A=2E_=D6mer_K=F6ker=22?= <omer@superonline.net>
To: "'David M. Chess'" <CHESS@watson.ibm.com>,
"'Steve Neruda'"
<steve_neruda@nationwide.com>
Cc: "'www-security@ns2.rutgers.edu'" <www-security@ns2.rutgers.edu>
Date: Fri, 15 Nov 1996 21:06:14 +0200
Errors-To: owner-www-security@ns2.rutgers.edu
>----------
>From: Steve Neruda[SMTP:steve_neruda@nationwide.com]
>Sent: 14 Kas=FDm 1996 Per=FEembe 17:21
>To: David M. Chess
>Cc: www-security@ns2.rutgers.edu
>Subject: Re: Alta Vista may or may not harvest unadvertised documents
>[...]
>
>Remember is a web crawler can find it then your competition can!
Again I call everyones attention to robot exclusion standarts. A
robots.txt will keep wanderers and crawlers away!!!!!! Also running 2
different httpd daeomns under different ports with different doc-roots
should solve most of our problems....
>SteveN
>
>
>Steve Neruda Steve_Neruda@Nationwide.Com
>Senior Internet Consultant The Internet Technologies Group
>
> AT&T -- Any company with the Death Star as a logo=20
> can't be all bad
>
>
>
>
>
>-----BEGIN PGP SIGNATURE-----
>Version: 2.6.2
>
>iQCVAwUBMos4xd9VrcmyuFZxAQH5DgQAgaeNBI0VHiQok0+N8wK2CvrD0YTxh/zh
>uVo7KN0qrnXQ7071WK1flyGOsCyNO504M4Ri5FftH4ijAT/HwWNxH88NddO72kwH
>RpyrHbAU8JQw6MOaMZqFjHVBU9YQeSiS6JgyY+HXy9m9r+KXP5euNNdsVvc1y21u
>YNIDNWX5Bgc=3D
>=3DUvj8
>-----END PGP SIGNATURE-----
>
