View Full Version : MSNbot Spider?
Johnny Pneumatic
12-01-2004, 02:14 AM
I was looking at who was online and several "MSNbot Spiders" showed on the list. What the hell are those?
Goliath
12-01-2004, 02:17 AM
Don't worry, they aren't poisonous. Now those Yahoo! Slurp Spiders, on the other hand.....
:D Just kidding. The MSNbot Spiders are bots (in this case, bots for MSN) that are scanning the pages here for archiving in search engines.
livius drusus
12-01-2004, 02:49 AM
Yup. What he said. Tons of search engines send out bots to crawl and index sites. We've got it configured to recognize something like 70 different search engines and to tag them in Who's Online. Other vB boards just use the generic "guest" designation even for spiders.
dave_a
12-01-2004, 05:41 AM
Yup. What he said. Tons of search engines send out bots to crawl and index sites. We've got it configured to recognize something like 70 different search engines and to tag them in Who's Online. Other vB boards just use the generic "guest" designation even for spiders.
Eons ago there was a thread started by either yourself of VM where you were asking of the members here if we wanted a private forum, free of the spying eyes of the terminator 2000 search and destroy bots.
Anything come of that?
I really detest search bots.
livius drusus
12-01-2004, 01:39 PM
I bumped it (http://www.freethought-forum.com/forum/showthread.php?p=24466#post24466), dantonac.
vBulletin® v3.8.2, Copyright ©2000-2012, Jelsoft Enterprises Ltd.