Googlebot acting strange

Anyone know why googlebot would be looking up words in my online
dictionary? There are no links to the words anywhere that I can find
and it's making no sense to me. It's performing a steady stream of
lookups with no rhyme nor reason to the words that I can see (it's not
alphabetically going through every word in the dictionary, it's doing
acronyms too like NNTP, and it's been going on for days now).

This is the dictionary interface: http://www.cotse.com/cgi-bin/Dict

And here are some examples of what I have seen:

66.249.65.70 - - [24/Jun/200553:14 -0400] "GET /cgi-bin/Dict?
Form=Dict2&Database=*&Query=Bridle HTTP/1.1" 200 48481 "-" "Mozilla/5.0
(compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

and it has even done phrases:

66.249.65.70 - - [24/Jun/200518:16 -0400] "GET /cgi-bin/Dict?
Form=Dict2&Database=*&Query=To+hear+a+bird+sing HTTP/1.1" 200 45149 "-"
"Mozilla/5.0 (compatible; Googlebot/2.1;
+http://www.google.com/bot.html)"

It's not hurting my server performance and I know I could do a
robots.txt entry to stop them, but I'm more curious as to why it is
happening, mainly because I don't see how it could be happening.

/steve
--
Free Privacy Resources
http://www.cotse.net/resources.html

In article <MPG.1d260ddd2da6816c989a9f@38.144.126.106>,
steve@packetderm.com.bogus says...
> Anyone know why googlebot would be looking up words in my online
> dictionary? There are no links to the words anywhere that I can find
> and it's making no sense to me. It's performing a steady stream of
> lookups with no rhyme nor reason to the words that I can see (it's not
> alphabetically going through every word in the dictionary, it's doing
> acronyms too like NNTP, and it's been going on for days now).
>
> This is the dictionary interface: http://www.cotse.com/cgi-bin/Dict
>
> And here are some examples of what I have seen:
>
> 66.249.65.70 - - [24/Jun/200553:14 -0400] "GET /cgi-bin/Dict?
> Form=Dict2&Database=*&Query=Bridle HTTP/1.1" 200 48481 "-" "Mozilla/5.0
> (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
>
> and it has even done phrases:
>
> 66.249.65.70 - - [24/Jun/200518:16 -0400] "GET /cgi-bin/Dict?
> Form=Dict2&Database=*&Query=To+hear+a+bird+sing HTTP/1.1" 200 45149 "-"
> "Mozilla/5.0 (compatible; Googlebot/2.1;
> +http://www.google.com/bot.html)"
>
> It's not hurting my server performance and I know I could do a
> robots.txt entry to stop them, but I'm more curious as to why it is
> happening, mainly because I don't see how it could be happening.
>
> /steve
>
I think I figured it out. I'll bet someone running googlebar uses my
online dictionaries regularly. I know that pages visited by someone
running googlebar are added to the spiders "to be indexed" database and
that is how some "never linked anywhere" pages end up in google. That
is probably this case too.

/steve
--
Free Privacy Resources
http://www.cotse.net/resources.html