Re: How do I keep google from spidering?

On Mon, 26 Sep 2005 1315 -0500, David Dyer-Bennet wrote:
...
> These are, of course, purely advisory; nothing *compels* any spider to
> conform to them. But all the major search engines have always done so
> since they were introduced. Depending on the degree of guarantee of
> privacy you're looking for, that might not be considered sufficient.

I just want to reduce bandwidth from general public usage, nothing really
private per se to hide. If I can keep googlers out that should help quite
a bit, so if google bots respect robots.txt that should suffice, along
with yahoo.

Proteus <proteus@uselessemail.net> writes:

> On Mon, 26 Sep 2005 1315 -0500, David Dyer-Bennet wrote:
> ..
> > These are, of course, purely advisory; nothing *compels* any spider to
> > conform to them. But all the major search engines have always done so
> > since they were introduced. Depending on the degree of guarantee of
> > privacy you're looking for, that might not be considered sufficient.
>
> I just want to reduce bandwidth from general public usage, nothing really
> private per se to hide. If I can keep googlers out that should help quite
> a bit, so if google bots respect robots.txt that should suffice, along
> with yahoo.

That should work out fine, then.
--
David Dyer-Bennet, <mailto:dd-b@dd-b.net>, <http://www.dd-b.net/dd-b/>
RKBA: <http://noguns-nomoney.com/> <http://www.dd-b.net/carry/>
Pics: <http://dd-b.lighthunters.net/> <http://www.dd-b.net/dd-b/SnapshotAlbum/>
Dragaera/Steven Brust: <http://dragaera.info/>