6 - 4 --[none specified: empty or whitespace]-- 43 ArchitextSpider 11 BackRub/2.1 backrub@backrub.stanford.edu http://backrub.stanford.edu/ 1 BackRub/2.1 backrub@google.stanford.edu http://google.stanford.edu/ 1 BackRub/2.1 backrub@google.stanford.edu http://google.stanford.eduu/ 25 Crawler V 0.2.1 admin@crawler.de 1 EchO!/2.0 1 GAIS Robot/1.1A1 8 Googlebot/1.0 googlebot@googlebot.com http://googlebot.com/ 2 Gulliver/1.2 2 htdig/3.0.8b2 (andrew@contigo.com) 5 htdig/3.1.0b4 (HSH@taxon.demon.nl) 12 htdig/3.1.0b4 (webmaster@javawoman.com) 16 ia_archiver 1 ia_archiver/1.6 2 InfoSeek Sidewinder/0.9 3 Java1.1.4 1 Java1.1.5 54 KIT-Fireball/2.0 1 LinkAlarm/1.00 2 LinkAlarm/1.04 2 LinkAlarm/1.04b 13 LinkWalker 2 lwp-trivial/1.26 13 Lycos_Spider_(T-Rex) 15 Mercator-1.0 1 Mozilla/3.0 (OS/2; U) 2 Mozilla/3.01 (Win95; I) 154 Mozilla/4.0 (compatible; MSIE 4.01; MSIECrawler; Windows 95) 15 Mozilla/4.0 (compatible; MSIE 4.01; MSIECrawler; Windows NT) 4 Mozilla/4.0 (compatible; MSIE 4.0; MSIECrawler; Windows 95) 2 Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) CGA 2 Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) Pfizer, Inc. 2 Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) Tele-Communications, Inc. 1 Mozilla/4.0 (compatible; MSIE 5.0b1; MSIECrawler; Windows NT) 1 Mozilla/4.0 (compatible; MSIE 5.0b2; Windows NT; AIM Package Version 1.07.3; MSIECrawler) 1 Mozilla/4.05 [en] (Win95; U; Netcaster) 1 Mozilla/4.07 [de] (Win95; I; Netcaster) 1 Namecrawler/1.0 3 NetIntellect (3.0; WinNT; I) 5 NetMechanic 2 Openfind Robot/1.1A1 1 Robot SuperSnooper 2 Robot@SuperSnooper.Com 2 Scanner 2.101 3 Scooter/1.0 scooter@pa.dec.com 2 Scooter/2.0 G.R.A.B. V1.0.3 15 Scooter/2.0 G.R.A.B. V1.1.0 8 Scooter/2.0 G.R.A.B. X2.0 56 Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) 1 Spider5 12 Ultraseek 1 vspider/3.5 5 WebNerd/0.1 2 WiseWire 1 WiseWire-Alpha12 2 WiseWire-HotSpider-1.0 11 WiseWire-Spider 5 WiseWire-Spider-1.0 11 WiseWire-Spider2 4 WiseWire-Widow-1.0 1 WiseWireSpider2 1 wURLwind-Reaper