| Robot |
Anzahl |
Prozent |
zuletzt |
| Mozilla/5.0 (compatible; Yahoo! Slurp;
http://help.yahoo.com/help/us/ysearch/slurp) |
32449 |
36.14% |
03.09.2010
03:00:35 |
| msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
7774 |
8.66% |
12.09.2009
22:49:06 |
| msnbot/2.0b (+http://search.msn.com/msnbot.htm) |
5752 |
6.41% |
03.09.2010
05:10:24 |
|
2731 |
3.04% |
03.09.2010
01:15:54 |
| Mozilla/5.0 (compatible; Googlebot/2.1;
+http://www.google.com/bot.html) |
1957 |
2.18% |
02.09.2010
17:40:08 |
| msnbot/1.1 (+http://search.msn.com/msnbot.htm) |
1695 |
1.89% |
31.01.2010
06:12:51 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html) |
1540 |
1.72% |
30.07.2010
22:17:35 |
| Googlebot/2.1 (+http://www.google.com/bot.html) |
1190 |
1.33% |
28.03.2006
11:54:31 |
| msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) |
1097 |
1.22% |
10.01.2009
19:18:27 |
| Speedy Spider
(http://www.entireweb.com/about/search_tech/speedy_spider/) |
1075 |
1.2% |
09.05.2010
16:56:14 |
| ia_archiver |
1016 |
1.13% |
23.11.2008
02:19:31 |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) |
984 |
1.1% |
01.09.2010
17:38:59 |
| Mozilla/5.0 (compatible; Yahoo! Slurp China;
http://misc.yahoo.com.cn/help.html) |
967 |
1.08% |
01.09.2010
13:28:26 |
| msnbot/0.3 (+http://search.msn.com/msnbot.htm) |
926 |
1.03% |
29.01.2005
22:08:05 |
| JobSpider_BA/1.1 |
897 |
1% |
13.01.2007
16:34:17 |
| Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) |
712 |
0.79% |
01.09.2010
11:22:11 |
| Gigabot/3.0 (http://www.gigablast.com/spider.html) |
674 |
0.75% |
02.09.2010
16:54:36 |
| msnbot/0.11 (+http://search.msn.com/msnbot.htm) |
665 |
0.74% |
18.09.2004
01:38:40 |
| ia_archiver-web.archive.org |
596 |
0.66% |
05.08.2010
14:12:26 |
| Sosospider+(+http://help.soso.com/webspider.htm) |
537 |
0.6% |
02.09.2010
21:29:34 |
| msnbot/0.9 (+http://search.msn.com/msnbot.htm) |
522 |
0.58% |
22.09.2006
01:30:23 |
| Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;)
Gecko/2008032620 |
511 |
0.57% |
02.08.2010
21:42:53 |
| Mozilla/5.0 (compatible; spbot/1.0; +http://www.seoprofiler.com/bot/ ) |
469 |
0.52% |
10.02.2010
15:11:27 |
| Yandex/1.01.001 (compatible; Win16; I) |
419 |
0.47% |
28.06.2010
10:32:54 |
| +http://robot.vedens.de VEDENSBOT |
391 |
0.44% |
03.09.2010
00:08:57 |
| larbin_2.6.3 (larbin2.6.3@unspecified.mail) |
390 |
0.43% |
26.08.2010
11:33:11 |
| msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) |
385 |
0.43% |
02.09.2010
02:12:56 |
| Mozilla/5.0 (compatible; spbot/1.2; +http://www.seoprofiler.com/bot/ ) |
368 |
0.41% |
15.02.2010
20:56:48 |
| Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc
dot com) |
352 |
0.39% |
01.03.2008
06:23:10 |
| TheSuBot/0.1 (www.thesubot.de) |
350 |
0.39% |
10.11.2006
00:59:42 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
307 |
0.34% |
07.08.2008
20:44:43 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma;
+http://sp.ask.com/docs/about/tech_crawling.html) |
304 |
0.34% |
13.10.2007
02:01:32 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma;
+http://about.ask.com/en/docs/about/webmasters.shtml) |
297 |
0.33% |
18.06.2008
15:08:13 |
| WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html)
(Windows; U; Windows NT 5.1; ru-RU) |
292 |
0.33% |
09.09.2008
19:54:34 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA
1.2 (support.voilabot@orange-ftgroup.com) |
278 |
0.31% |
31.08.2010
00:59:02 |
| SurveyBot/2.3 (Whois Source) |
274 |
0.31% |
18.08.2009
13:27:21 |
| StackRambler/2.0 (MSIE incompatible) |
262 |
0.29% |
01.09.2010
01:30:19 |
| Yandex/1.01.001 (compatible; Win16; H) |
255 |
0.28% |
06.07.2010
22:46:54 |
| Googlebot/2.1 (+http://www.googlebot.com/bot.html) |
234 |
0.26% |
13.09.2008
03:31:03 |
| Gigabot/2.0 |
231 |
0.26% |
23.03.2007
18:36:07 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) Speedy Spider
(http://www.entireweb.com/about/search_tech/speedy_spider/) |
220 |
0.25% |
01.09.2010
16:50:13 |
| Baiduspider+(+http://www.baidu.com/search/spider_jp.html) |
211 |
0.24% |
03.03.2009
10:35:48 |
| Mozilla/5.0 (compatible; Ask Jeeves/Teoma;
+http://about.ask.com/en/docs/about/webmasters.shtml) |
196 |
0.22% |
12.08.2010
03:06:40 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA
1.2 (http://www.voila.com/) |
194 |
0.22% |
14.04.2008
12:55:46 |
| Mozilla/5.0 (compatible; Charlotte/1.1;
http://www.searchme.com/support/) |
192 |
0.21% |
07.09.2009
12:38:30 |
| Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.2 |
188 |
0.21% |
18.11.2008
23:40:42 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma) |
181 |
0.2% |
26.04.2008
16:21:03 |
| Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) |
175 |
0.19% |
01.09.2010
09:24:51 |
| MJ12bot/v1.2.0 (http://majestic12.co.uk/bot.php?+) |
173 |
0.19% |
26.10.2007
22:20:52 |
| Mozilla/5.0 (compatible; YodaoBot/1.0;
http://www.yodao.com/help/webmaster/spider/; ) |
168 |
0.19% |
26.09.2008
11:08:51 |
| envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.html) |
166 |
0.18% |
24.08.2010
13:30:47 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) |
165 |
0.18% |
03.09.2010
03:05:19 |
| MLBot (www.metadatalabs.com/mlbot) |
164 |
0.18% |
02.09.2010
02:23:41 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) |
162 |
0.18% |
03.06.2010
16:56:19 |
| ia_archiver (+http://www.alexa.com/site/help/webmasters;
crawler@alexa.com) |
154 |
0.17% |
01.09.2010
20:30:01 |
| Gigabot/3.0 blogs.gigablast.com |
152 |
0.17% |
04.11.2005
05:14:46 |
| Mozilla/4.0 |
145 |
0.16% |
31.01.2010
20:13:31 |
| NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net) |
138 |
0.15% |
12.04.2006
21:16:35 |
| nu_tch-princeton/Nu_tch-1.0-dev (princeton crawler for cass project;
http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot
edu) |
134 |
0.15% |
17.05.2010
02:44:01 |
| Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/) |
133 |
0.15% |
03.09.2010
06:17:34 |
| Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) |
131 |
0.15% |
19.10.2009
15:30:34 |
| Mediapartners-Google/2.1 |
124 |
0.14% |
13.02.2007
14:05:05 |
| Gigabot/3.0 |
123 |
0.14% |
15.09.2005
14:35:16 |
| SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html;
http://support.sitesell.com/contact-support.html) |
120 |
0.13% |
28.09.2006
00:07:22 |
| Nokia6682/2.0 (3.01.1) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0
configuration/CLDC-1.1 UP.Link/6.3.0.0.0
(compatible;YahooSeeker/M1A1-R2D2;
http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html) |
120 |
0.13% |
28.03.2008
22:29:38 |
| Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/,
crawler@dotnetdotcom.org) |
112 |
0.12% |
13.08.2010
12:50:48 |
| Mozilla/5.0 (compatible; YoudaoBot/1.0;
http://www.youdao.com/help/webmaster/spider/; ) |
109 |
0.12% |
29.08.2010
21:37:15 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727) |
109 |
0.12% |
24.07.2010
20:37:24 |
| Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
103 |
0.11% |
18.07.2010
14:28:24 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler) |
102 |
0.11% |
22.02.2009
19:18:19 |
| Speedy Spider
(http://www.entireweb.com/about/search_tech/speedyspider/) |
102 |
0.11% |
17.01.2008
22:51:13 |
| Mozilla/5.0 (compatible; spbot/1.1; +http://www.seoprofiler.com/bot/ ) |
102 |
0.11% |
11.02.2010
17:09:24 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
98 |
0.11% |
02.11.2006
12:47:19 |
| appie 1.1 (www.walhello.com) |
97 |
0.11% |
11.09.2009
22:55:16 |
| Mozilla/5.0 (compatible; spbot/2.0.2; +http://www.seoprofiler.com/bot/
) |
97 |
0.11% |
23.05.2010
09:21:35 |
| Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com) |
95 |
0.11% |
22.06.2010
05:57:16 |
| voyager/1.0 |
94 |
0.1% |
01.01.2008
07:29:52 |
| Gigabot/2.0/gigablast.com/spider.html |
94 |
0.1% |
02.11.2006
19:58:39 |
| Mozilla/5.0 (compatible; Yahoo! Slurp/3.0;
http://help.yahoo.com/help/us/ysearch/slurp) |
93 |
0.1% |
30.08.2010
03:22:22 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSIECrawler) |
92 |
0.1% |
28.08.2008
09:37:16 |
| Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot
com) |
92 |
0.1% |
04.03.2006
10:41:15 |
| NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net) |
89 |
0.1% |
12.07.2006
08:17:10 |
| Baiduspider+(+http://www.baidu.jp/spider/) |
89 |
0.1% |
11.08.2010
06:06:47 |
| Jakarta Commons-HttpClient/3.1 |
88 |
0.1% |
13.05.2010
23:42:14 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.4;
http://www.majestic12.co.uk/bot.php?+) |
87 |
0.1% |
25.07.2009
15:16:14 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.1;
http://www.majestic12.co.uk/bot.php?+) |
86 |
0.1% |
07.08.2008
08:10:31 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; MSIECrawler) |
83 |
0.09% |
29.07.2008
09:30:57 |
| SiteSearch/2.0 (sitesearch.gigablast.com) |
81 |
0.09% |
24.05.2005
23:14:37 |
| Mozilla/5.0 (compatible; Speedy Spider;
http://www.entireweb.com/about/search_tech/speedy_spider/) |
80 |
0.09% |
12.03.2010
09:13:10 |
| http://www.almaden.ibm.com/cs/crawler [fc2] |
79 |
0.09% |
16.05.2006
02:31:24 |
| Mozilla/4.0 (compatible; NaverBot/1.0;
http://help.naver.com/delete_main.asp) |
78 |
0.09% |
12.12.2008
10:08:53 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
74 |
0.08% |
24.10.2006
15:28:12 |
| favorstarbot/1.0 (+http://favorstar.com/bot.html) |
73 |
0.08% |
09.11.2007
12:13:11 |
| Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector;
+http://yandex.com/bots) |
73 |
0.08% |
02.09.2010
14:41:42 |
| VisBot/2.0 (Visvo.com Crawler; http://www.visvo.com/bot.html;
bot@visvo.com) |
72 |
0.08% |
16.07.2008
16:16:18 |
| Mozilla/4.0 (compatible; NaverBot/1.0;
http://help.naver.com/customer_webtxt_02.jsp) |
71 |
0.08% |
24.04.2010
18:16:54 |
| Mozilla/4.7 [en] (X11; I; SunOS 5.8 sun4u) |
69 |
0.08% |
14.10.2006
14:03:36 |
| sogou spider |
69 |
0.08% |
26.03.2007
23:31:39 |
| SBIder/SBIder-0.8.2-dev (http://www.sitesell.com/sbider.html) |
68 |
0.08% |
26.02.2008
20:47:06 |
| Mozilla/4.0 compatible FurlBot/Furl Search 2.0 (FurlBot;
http://www.furl.net; wn.furlbot@looksmart.net) |
67 |
0.07% |
01.07.2008
02:11:04 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
66 |
0.07% |
07.11.2006
20:54:39 |
| Exabot/3.0 |
65 |
0.07% |
15.01.2007
03:38:27 |
| Mozilla/5.0 (compatible; BecomeBot/3.0;
+http://www.become.com/site_owners.html) |
65 |
0.07% |
28.12.2008
21:58:10 |
| holmes/3.12.4 (http://morfeo.centrum.cz/bot) |
65 |
0.07% |
27.01.2009
11:42:52 |
| Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) |
65 |
0.07% |
02.09.2010
19:57:18 |
| Mozilla/5.0 (compatible; Kyluka crawl;
http://www.kyluka.com/crawl.html; crawl@kyluka.com) |
61 |
0.07% |
06.04.2007
08:57:19 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
61 |
0.07% |
05.08.2006
20:54:43 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) Larbin/2.6.3
(larbin@unspecified.mail) |
60 |
0.07% |
21.03.2006
13:23:31 |
| MJ12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+) |
60 |
0.07% |
06.07.2006
06:47:29 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
59 |
0.07% |
24.01.2007
10:56:47 |
| NutchCVS/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
59 |
0.07% |
18.06.2006
21:40:53 |
| ichiro/2.0 (http://help.goo.ne.jp/door/crawler.html) |
59 |
0.07% |
16.01.2008
13:02:53 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.5;
http://www.majestic12.co.uk/bot.php?+) |
59 |
0.07% |
10.12.2009
01:33:12 |
| Lsearch/sondeur |
58 |
0.06% |
07.02.2008
23:15:00 |
| Mozilla/5.0 (compatible; Interseek/3.1) |
57 |
0.06% |
24.06.2007
23:38:55 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727) |
57 |
0.06% |
01.09.2010
00:28:24 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; Girafabot; girafabot at
girafa dot com; http://www.girafa.com) |
56 |
0.06% |
06.11.2007
09:29:09 |
| Mozilla/5.0 (compatible; Tagoobot/3.0; +http://www.tagoo.ru) |
56 |
0.06% |
25.01.2010
18:12:17 |
| Mozilla/5.0 (compatible; spbot/2.0.4; +http://www.seoprofiler.com/bot
) |
56 |
0.06% |
03.09.2010
07:56:18 |
| Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.7.8) Gecko/20050512
Firefox/1.0.4 |
55 |
0.06% |
27.05.2010
02:12:12 |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker
(wn.dlc@looksmart.net; http://www.WISEnutbot.com) |
54 |
0.06% |
16.09.2006
11:21:06 |
| Sogou web
spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07) |
54 |
0.06% |
11.04.2008
00:00:35 |
| Jakarta Commons-HttpClient/3.0-rc4 |
52 |
0.06% |
20.12.2005
04:50:46 |
| Speedy Spider (Entireweb; Beta/1.0;
http://www.entireweb.com/about/search_tech/speedyspider/) |
52 |
0.06% |
03.04.2007
09:27:11 |
| eagle |
50 |
0.06% |
03.06.2007
20:17:36 |
| Yeti/1.0 (+http://help.naver.com/robots/) |
50 |
0.06% |
24.08.2008
17:11:36 |
| Snapbot/1.0 |
48 |
0.05% |
11.04.2007
17:10:00 |
| Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows
server; +http://ws.daum.net/aboutWebSearch.html) Daumoa/2.0 |
48 |
0.05% |
12.08.2010
20:46:04 |
| NG/2.0 |
47 |
0.05% |
07.05.2009
18:34:34 |
| Gigabot/2.0; http://www.gigablast.com/spider.html |
47 |
0.05% |
07.10.2006
09:47:33 |
| holmes/3.12.2 (http://morfeo.centrum.cz/bot) |
47 |
0.05% |
05.06.2008
11:21:10 |
| Googlebot-Image/1.0 |
46 |
0.05% |
04.07.2010
09:11:30 |
| RedKernel WWW-Spider 2/0 (+http://www-spider.redkernel-softwares.com/) |
46 |
0.05% |
12.08.2006
14:31:13 |
| Ocelli/1.4 (http://www.globalspec.com/Ocelli) |
46 |
0.05% |
05.08.2010
08:55:09 |
| Shim-Crawler(Mozilla-compatible;
http://www.logos.ic.i.u-tokyo.ac.jp/crawler/;
crawl@logos.ic.i.u-tokyo.ac.jp) |
44 |
0.05% |
05.02.2007
16:39:08 |
| Mozilla/5.0 (compatible; TridentSpider/3.1) |
44 |
0.05% |
12.06.2007
06:48:42 |
| TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) |
44 |
0.05% |
20.07.2010
11:24:27 |
| Java/1.6.0_16 |
44 |
0.05% |
20.05.2010
11:31:44 |
| Spinne/2.0 Osttirol |
43 |
0.05% |
24.06.2004
21:19:16 |
| Mail.Ru/1.0 |
43 |
0.05% |
31.08.2010
21:42:58 |
| betaBot |
43 |
0.05% |
04.03.2010
10:16:49 |
| del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4;
FreeBSD) KHTML/3.4.2 (like Gecko) |
42 |
0.05% |
02.06.2009
21:45:34 |
| al_viewer (larbin2.6.3@unspecified.mail) |
42 |
0.05% |
23.04.2010
16:09:27 |
| Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot@grub.org) |
41 |
0.05% |
13.11.2008
04:48:44 |
| TurnitinBot/2.0 (http://www.turnitin.com/robot/crawlerinfo.html) |
40 |
0.04% |
10.07.2006
08:33:29 |
| Exabot/2.0 |
40 |
0.04% |
20.08.2006
00:31:06 |
| Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/rob
ot.php) |
40 |
0.04% |
28.06.2010
05:29:24 |
| RedBot/redbot-1.0 (Rediff.com Crawler; redbot at rediff dot com) |
40 |
0.04% |
10.08.2007
11:50:53 |
| Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and
follow it) |
39 |
0.04% |
11.03.2008
03:49:03 |
| SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1
UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible;
Googlebot-Mobile/2.1; +http://www.google.com/bot.html) |
39 |
0.04% |
24.06.2010
18:58:35 |
| IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) |
38 |
0.04% |
23.07.2005
01:21:01 |
| NutchCVS/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
38 |
0.04% |
10.08.2006
13:33:56 |
| Sogou web
spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) |
38 |
0.04% |
27.08.2010
13:43:08 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2
(http://www.voila.com/) |
36 |
0.04% |
28.03.2007
01:46:37 |
| Mozilla/5.0 (compatible; Charlotte/1.0b;
http://www.searchme.com/support/) |
36 |
0.04% |
29.12.2007
02:57:36 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13)
Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3
(DomainTools) |
36 |
0.04% |
25.08.2010
14:55:16 |
| Mozilla/5.0 (compatible; spbot/2.0; +http://www.seoprofiler.com/bot/ ) |
36 |
0.04% |
01.03.2010
20:49:00 |
| http://www.almaden.ibm.com/cs/crawler [bc3] |
35 |
0.04% |
29.12.2006
22:32:19 |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) |
35 |
0.04% |
30.06.2006
19:32:51 |
| Speedy Spider (Entireweb; Beta/1.1;
http://www.entireweb.com/about/search_tech/speedyspider/) |
35 |
0.04% |
07.05.2007
20:10:47 |
| disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com;
disco-crawl@discoveryengine.com) |
35 |
0.04% |
23.12.2007
10:27:18 |
| SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler;
http://www.similarpages.com; info at similarpages dot com) |
35 |
0.04% |
21.03.2009
01:14:30 |
| CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler;
http://www.cazoodle.com; mqbot@cazoodle.com) |
34 |
0.04% |
05.12.2007
23:42:38 |
| FDF-Bot - Free Domainfinder by www.geld13.de |
34 |
0.04% |
19.03.2009
11:08:32 |
| Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/) |
34 |
0.04% |
01.09.2010
13:42:42 |
| Jetbot/1.0 |
33 |
0.04% |
06.11.2004
18:48:28 |
| Mozilla/5.0 (compatible; discobot/1.1;
+http://discoveryengine.com/discobot.html) |
33 |
0.04% |
17.02.2010
01:02:40 |
| bot/1.0 (bot; http://; bot@bot.bot) |
32 |
0.04% |
05.06.2008
21:03:16 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322;
MSIECrawler) |
31 |
0.03% |
05.10.2007
17:41:40 |
| Gigabot/1.0 |
31 |
0.03% |
22.07.2008
21:56:53 |
| ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl) |
31 |
0.03% |
09.11.2006
10:27:40 |
| LexxeBot/1.0 (lexxebot@lexxe.com) |
31 |
0.03% |
11.08.2009
21:37:49 |
| gamekitbot/1.0 (+http://www.uchoose.de/crawler/gamekitbot/) |
30 |
0.03% |
06.01.2007
12:22:53 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322;
MSIECrawler) |
30 |
0.03% |
22.12.2005
13:37:32 |
| SeznamBot/1.0 (+http://fulltext.seznam.cz/) |
30 |
0.03% |
18.05.2006
00:49:52 |
| iCCrawler (http://www.iccenter.net/bot.htm) |
30 |
0.03% |
12.07.2006
12:08:48 |
| holmes/3.10.1 (OnetSzukaj/5.0; +http://szukaj.onet.pl) |
30 |
0.03% |
08.05.2007
07:22:27 |
| CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler;
http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) |
30 |
0.03% |
01.01.2008
18:22:16 |
| holmes/3.12 (OnetSzukaj/5.0; +http://szukaj.onet.pl) |
30 |
0.03% |
30.06.2008
18:47:07 |
| Mozilla/5.0 (compatible; spbot/2.0.1; +http://www.seoprofiler.com/bot/
) |
30 |
0.03% |
16.03.2010
03:16:47 |
| gonzo1[P] mailto:crawleradmin.t-info@telekom.de |
29 |
0.03% |
11.09.2006
12:20:21 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
29 |
0.03% |
20.08.2006
14:56:57 |
| Pingdom GIGRIB (http://www.pingdom.com) |
29 |
0.03% |
24.11.2007
13:56:48 |
| MSRBOT (http://research.microsoft.com/research/sv/msrbot/ |
29 |
0.03% |
24.09.2008
04:19:38 |
| updated/0.1beta (updated.com; http://www.updated.com;
crawler@updated.com) |
28 |
0.03% |
23.09.2005
05:45:21 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
28 |
0.03% |
12.05.2006
13:54:37 |
| Toplistbot |
28 |
0.03% |
10.06.2009
13:57:21 |
| Mozilla/5.0 (compatible; MJ12bot/v1.3.3;
http://www.majestic12.co.uk/bot.php?+) |
28 |
0.03% |
24.08.2010
03:23:29 |
| WIRE/0.11 (Linux; i686; Robot,Spider,Crawler,aromano@cli.di.unipi.it) |
27 |
0.03% |
02.07.2006
02:17:52 |
| Mozilla/4.0 (compatible; MSIE enviable; DAUMOA 2.0; DAUM Web Robot;
Daum Communications Corp., Korea; +http://ws.daum.net/aboutkr.html) |
27 |
0.03% |
29.08.2008
06:41:42 |
| DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html) |
27 |
0.03% |
21.06.2010
19:15:05 |
| Mozilla/5.0 (compatible; discobot/1.0;
+http://discoveryengine.com/discobot.html) |
26 |
0.03% |
17.03.2009
21:43:55 |
| baypup/1.1 (Baypup; http://www.baypup.com/; jason@baypup.com) |
26 |
0.03% |
29.09.2009
02:07:42 |
| Chen Li/Nutch-1.0 (Nutch spiderman; http://chenli.com.cn;
chenlibiti@163.com) |
26 |
0.03% |
13.06.2010
05:05:34 |
| Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.7.10) Gecko/20050724
Firefox/1.0.6 |
25 |
0.03% |
07.10.2007
03:52:14 |
| IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler) |
25 |
0.03% |
29.07.2007
05:41:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera
8.01/Nutch-0.9 (http://lucene.apache.org/nutch/about.html;
http://lucene.apache.org/nutch/bot.html; mail@dev.null) |
25 |
0.03% |
23.04.2007
20:37:23 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.12; ips-agent)
Gecko/20050922 Fedora/1.0.7-1.1.fc4 Firefox/1.0.7 |
25 |
0.03% |
05.10.2009
10:57:59 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.3;
http://www.majestic12.co.uk/bot.php?+) |
25 |
0.03% |
14.07.2009
00:02:43 |
| Iceweasel2.0.0.16/Nutch-1.0 (Webbrowser; http://iceweasel.com;
info@iceweasel.com) |
25 |
0.03% |
06.11.2009
13:49:19 |
| rdfbot/1.0 (rdfbotsupport AT rediffmailpro DOT com) |
25 |
0.03% |
23.12.2009
05:11:24 |
| Patwebbot (http://www.herz-power.de/technik.html) |
24 |
0.03% |
20.05.2006
01:38:21 |
| Speedy Spider (Beta/1.0; speedy@entireweb.com) |
24 |
0.03% |
17.04.2005
21:36:28 |
| Sensis Web Crawler (search_commentsatsensisdotcomdotau) |
24 |
0.03% |
31.05.2007
08:41:22 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; .NET CLR 2.0.50727; MSIECrawler) |
24 |
0.03% |
11.08.2008
18:49:25 |
| page_verifier (http://www.securecomputing.com/goto/pv) |
24 |
0.03% |
05.11.2008
03:16:11 |
| Speedy Spider (Entireweb; Beta/1.3;
http://www.entireweb.com/about/search_tech/speedyspider/) |
24 |
0.03% |
28.05.2007
09:30:51 |
| Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html) |
23 |
0.03% |
13.04.2004
22:34:42 |
| "Mozilla/5.0 (X11; U; Linux i686;en-US; rv:1.2.1) Gecko/20030225" |
23 |
0.03% |
23.02.2006
03:44:15 |
| IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler) |
23 |
0.03% |
20.07.2006
06:49:27 |
| sproose/1.0beta (sproose bot; http://www.sproose.com/bot.html;
crawler@sproose.com) |
23 |
0.03% |
17.03.2007
05:21:23 |
| Wget/1.10.2 |
23 |
0.03% |
08.04.2010
05:49:18 |
| PHPCrawl |
23 |
0.03% |
15.12.2009
14:07:03 |
| PrivacyFinder/1.1 |
23 |
0.03% |
16.08.2009
01:16:39 |
| anbo-ubot-0.1a/Nutch-1.0 (anbos ubot; http://www.unister-gmbh.de;
crawler at unister-gmbh dot de) |
23 |
0.03% |
19.06.2010
04:34:53 |
| NutchCVS/0.7.2 (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
22 |
0.02% |
04.06.2007
06:15:35 |
| MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) |
22 |
0.02% |
16.01.2007
18:09:18 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705;
.NET CLR 1.1.4322) |
22 |
0.02% |
22.09.2006
14:26:05 |
| VadixBot |
22 |
0.02% |
28.02.2008
03:10:52 |
| GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html) |
22 |
0.02% |
16.01.2009
09:18:43 |
| SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler;
http://www.similarpages.com; info@similarpages.com) |
22 |
0.02% |
07.09.2009
18:05:43 |
| Mozilla/5.0 (compatible; GurujiBot/1.0;
+http://www.guruji.com/en/WebmasterFAQ.html) |
22 |
0.02% |
13.12.2009
02:06:17 |
| nutch/Nutch-1.0-dev (nutch) |
21 |
0.02% |
16.07.2008
11:14:34 |
| CCBot/1.0 (+http://www.commoncrawl.org/bot.html) |
21 |
0.02% |
03.09.2010
08:17:20 |
| User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US;
rv:1.9.1.5) Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729) |
21 |
0.02% |
30.07.2010
16:50:39 |
| COMODOspider/Nutch-1.0 |
21 |
0.02% |
02.07.2010
18:18:07 |
| Vagabondo/3.0 (webagent at wise-guys dot nl) |
20 |
0.02% |
12.05.2006
14:06:16 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
19 |
0.02% |
18.05.2004
20:06:04 |
| Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) |
19 |
0.02% |
09.02.2005
02:20:40 |
| Gaisbot/3.0+(jerry_wu@openfind.com.tw;+http://gais.cs.ccu.edu.tw/robot
.php) |
19 |
0.02% |
27.01.2006
05:19:10 |
| Speedy Spider (Beta/1.0; www.entireweb.com) |
19 |
0.02% |
01.09.2006
23:12:08 |
| Mozilla/4.0 (compatible;) |
19 |
0.02% |
26.01.2006
14:04:12 |
| Gigabot/2.0 (http://www.gigablast.com/spider.html) |
19 |
0.02% |
13.10.2007
21:43:33 |
| holmes/3.11 (http://morfeo.centrum.cz/bot) |
19 |
0.02% |
02.11.2007
23:04:14 |
| holmes/3.12.1 (http://morfeo.centrum.cz/bot) |
19 |
0.02% |
24.01.2008
01:09:40 |
| PDFBot (crawler@pdfind.com) |
19 |
0.02% |
11.09.2008
15:07:47 |
| Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter);
+http://www.exabot.com/go/robot) |
19 |
0.02% |
14.04.2010
21:29:44 |
| NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) |
18 |
0.02% |
20.06.2005
04:09:20 |
| telnet0.1 (noone@example.org) |
18 |
0.02% |
18.05.2005
20:32:39 |
| NaverBot-1.0 (NHN Corp. / +82-31-784-1989 / nhnbot@naver.com) |
18 |
0.02% |
17.09.2006
14:59:21 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312462) |
18 |
0.02% |
21.01.2007
22:11:14 |
| WebAlta Crawler/1.3.33
(http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows
NT 5.1; ru-RU) |
18 |
0.02% |
03.07.2007
06:36:08 |
| SeekGen/Nutch-0.9 (SeekGenBot; http://www.seekgen.com; Email) |
18 |
0.02% |
17.04.2008
19:22:02 |
| beast/Nutch-0.9 (agentpider; agent.email.com; beast@gmail.com) |
18 |
0.02% |
15.09.2008
20:02:57 |
| DoCoMo/2.0 N902iS(c100;TB;W24H12)(compatible; moba-crawler;
http://crawler.dena.jp/) |
18 |
0.02% |
24.05.2009
01:40:48 |
| Eurobot/1.1 (http://eurobot.ayell.eu) |
18 |
0.02% |
11.02.2010
00:42:32 |
| Mozilla/5.0 (compatible; MJ12bot/v1.3.2;
http://www.majestic12.co.uk/bot.php?+) |
18 |
0.02% |
28.07.2010
19:57:57 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; MSIECrawler) |
17 |
0.02% |
19.12.2007
16:38:04 |
| larbin_2.6.3 (wgao@genieknows.com) |
17 |
0.02% |
05.10.2005
22:53:39 |
| Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
17 |
0.02% |
14.06.2006
23:29:05 |
| Mozilla/5.0 (compatible; BecomeBot/3.0; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
17 |
0.02% |
12.09.2006
11:03:44 |
| visit_www.yourpoll.net (root@localhost) |
17 |
0.02% |
30.07.2007
15:29:31 |
| Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys
robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot
at balihoo dot com) |
17 |
0.02% |
21.06.2008
12:47:18 |
| panscient.com |
17 |
0.02% |
20.07.2010
04:01:08 |
| MLBot (www.metadatalabs.com) |
17 |
0.02% |
21.04.2008
09:35:43 |
| TinEye/1.1 (http://tineye.com/crawler.html) |
17 |
0.02% |
24.07.2008
03:00:27 |
| Mozilla/5.0 (compatible; MooseBot/1.1; U; Linux i686; de;
+http://www.moose.at/) |
17 |
0.02% |
18.04.2010
19:44:43 |
| Nutch/Nutch-1.0-dev (A Nutch-based crawler.;
http://lucene.apache.org/nutch/bot.html; nutch-agent AT
lucene.apache.org) |
17 |
0.02% |
21.04.2010
10:39:42 |
| Mozilla/5.0 (compatible; KaloogaBot;
http://www.kalooga.com/info.html?page=crawler) |
17 |
0.02% |
13.01.2010
21:19:46 |
| lmspider (lmspider@scansoft.com) |
16 |
0.02% |
24.07.2005
02:01:10 |
| Mozilla/4.0
Accept: */*
Accept-Language: en-us, en, de;q=0.50 |
16 |
0.02% |
27.03.2005
04:34:38 |
| cfetch/1.0 |
16 |
0.02% |
21.11.2005
18:07:28 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8) Gecko/20051111
Firefox/1.5 |
16 |
0.02% |
08.08.2006
23:13:11 |
| MSRBOT |
16 |
0.02% |
06.04.2007
20:25:36 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.12) Gecko/20050922
Fedora/1.0.7-1.1.fc4 Firefox/1.0.7 |
16 |
0.02% |
23.09.2007
10:45:04 |
| sproose/0.1 (sproose bot; http://www.sproose.com/bot.html;
crawler@sproose.com) |
16 |
0.02% |
22.09.2006
09:42:34 |
| ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html;
icc-crawl(at)ml(dot)nict(dot)go(dot)jp) |
16 |
0.02% |
23.05.2007
01:57:54 |
| I411Crawling/Nutch-0.9 (CrawlData; www.i411.com; sbehera@i144.com) |
16 |
0.02% |
07.03.2008
00:30:33 |
| ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html) |
16 |
0.02% |
26.07.2010
00:30:08 |
| voyager/2.0 (http://www.kosmix.com/crawler.html) |
16 |
0.02% |
23.01.2010
09:31:02 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322) |
15 |
0.02% |
11.07.2008
21:59:12 |
| Ocelli/1.3 (http://www.globalspec.com/Ocelli) |
15 |
0.02% |
12.08.2007
08:57:08 |
| Python-urllib/1.16 |
15 |
0.02% |
02.08.2008
07:56:54 |
| Python-urllib/1.15 |
15 |
0.02% |
07.03.2007
07:13:02 |
| FAST MetaWeb Crawler (helpdesk at fastsearch dot com) |
15 |
0.02% |
30.09.2007
08:17:05 |
| OrangeSpider |
15 |
0.02% |
23.08.2007
00:54:30 |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0) |
15 |
0.02% |
04.08.2010
19:46:19 |
| Mozilla/5.0 (compatible; XmarksFetch/1.0;
+http://www.xmarks.com/about/crawler; info@xmarks.com) |
15 |
0.02% |
22.01.2010
03:58:01 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt) |
14 |
0.02% |
15.08.2010
01:29:07 |
| ichiro/1.0 (ichiro@nttr.co.jp) |
14 |
0.02% |
27.09.2005
16:59:31 |
| NetResearchServer/3.5(loopimprovements.com/robot.html) |
14 |
0.02% |
10.12.2005
09:25:42 |
| Twiceler www.cuill.com/robots.html |
14 |
0.02% |
21.05.2006
04:31:16 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.12)
Gecko/20050919 Firefox/1.0.7 |
14 |
0.02% |
17.05.2006
23:43:23 |
| FyberSpider |
14 |
0.02% |
30.12.2005
23:03:11 |
| Krugle/Krugle,Nutch/0.8+ (Krugle web crawler;
http://corp.krugle.com/crawler/info.html; webcrawler@krugle.com) |
14 |
0.02% |
23.10.2007
20:33:11 |
| DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1;
+http://www.google.com/bot.html) |
14 |
0.02% |
03.10.2008
00:18:34 |
| MSRBOT (http://research.microsoft.com/research/sv/msrbot) |
14 |
0.02% |
26.05.2007
17:10:02 |
| Snapbot/1.0 (Snap Shots, +http://www.snap.com) |
14 |
0.02% |
06.06.2008
08:58:12 |
| larbin_2.6.3 |
14 |
0.02% |
20.03.2010
17:05:45 |
| Novosoft Spider/Nutch-0.9 (http://www.novosoft.net) |
14 |
0.02% |
21.10.2007
12:20:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7)
Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool;
http://sagool.jp/) |
14 |
0.02% |
10.09.2008
20:41:47 |
| RAYSPIDER/Nutch-0.9 |
14 |
0.02% |
09.08.2008
18:22:22 |
| nutch-crawl/Nutch-1.0-dev (imcs; http://imcs.ro; admin@imcs.ro) |
14 |
0.02% |
28.03.2009
12:08:19 |
| GingerCrawler/1.0 (Language Assistant for Dyslexics;
www.gingersoftware.com/crawler_agent.htm; support at ginger software
dot com) |
14 |
0.02% |
28.01.2010
17:42:48 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.12) Gecko/2009070811
Ubuntu/9.04 (jaunty) Firefox/3.0.12/Nutch-1.0-dev (imcs;
http://imcs.ro; admin@imcs.ro) |
14 |
0.02% |
07.10.2009
05:27:12 |
| CligooRobot/1.0 |
14 |
0.02% |
29.08.2010
04:06:30 |
| Pompos/1.3 http://dir.com/pompos.html |
13 |
0.01% |
24.10.2005
17:17:41 |
| http://www.almaden.ibm.com/cs/crawler [c11] |
13 |
0.01% |
01.08.2005
11:43:48 |
| snap.com beta crawler v0 |
13 |
0.01% |
28.01.2006
18:59:34 |
| Mozilla/5.0 (compatible; OnetSzukaj/5.0; +http://szukaj.onet.pl) |
13 |
0.01% |
31.08.2006
10:55:38 |
| IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html) |
13 |
0.01% |
16.10.2006
21:32:00 |
| findlinks/1.1-a7 (+http://wortschatz.uni-leipzig.de/findlinks/) |
13 |
0.01% |
24.01.2006
12:28:17 |
| findlinks/1.1-a8 (+http://wortschatz.uni-leipzig.de/findlinks/) |
13 |
0.01% |
27.01.2006
02:55:19 |
| noxtrumbot/1.0 (crawler@noxtrum.com) |
13 |
0.01% |
27.01.2007
17:48:28 |
| BilgiBot/1.0(beta) (bilgi.com(beta);
http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
13 |
0.01% |
02.10.2006
17:46:12 |
| MQBOT/Nutch-0.9-dev (MQBOT Crawler; http://falcon.cs.uiuc.edu;
mqbot@cs.uiuc.edu) |
13 |
0.01% |
26.01.2007
13:17:04 |
| GiNDev/Nutch-0.9 (Germanistik im Netz;
http://www.germanistik-im-netz.de/gin-www-search/gin-www-search-about.
html; D dot Eichner at ub dot uni-frankfurt dot de) |
13 |
0.01% |
28.04.2008
19:10:05 |
| Mozilla/4.0 http://referencement.abaabaa.com/add_url.php : Easy
referencement (version 1.0) |
13 |
0.01% |
16.07.2009
11:49:33 |
| http://www.almaden.ibm.com/cs/crawler [c01] |
12 |
0.01% |
07.09.2004
19:04:03 |
| QuepasaCreep ( crawler@quepasacorp.com ) |
12 |
0.01% |
15.06.2004
04:50:29 |
| search.ch V1.4.2 (spiderman@search.ch; http://www.search.ch) |
12 |
0.01% |
15.06.2005
04:10:25 |
| Holmes/1.0 |
12 |
0.01% |
28.03.2005
12:27:34 |
| envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.php) |
12 |
0.01% |
30.09.2006
01:54:34 |
| larbin_2.6.3 (gqnmgsp@ruc.edu.cn) |
12 |
0.01% |
01.11.2009
23:07:18 |
| WebCrawler_1.1 (internet@bredband.net) |
12 |
0.01% |
08.03.2007
14:05:25 |
| Mozilla/5.0 (compatible; Exabot-Images/3.0;
+http://www.exabot.com/go/robot) |
12 |
0.01% |
22.11.2009
21:29:53 |
| LarbinWebCrawler (spider@download11.com) |
12 |
0.01% |
08.04.2007
01:51:01 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.7pre)
Gecko/20070815 Firefox/2.0.0.6 Navigator/9.0b3 |
12 |
0.01% |
20.10.2008
17:33:41 |
| robotgenius/Nutch-1.0-dev |
12 |
0.01% |
10.11.2008
07:53:03 |
| flatlandbot/baypup (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot;
jason@flatlandindustries.com) |
12 |
0.01% |
04.05.2009
06:32:07 |
| LinkStar Research Crawler (http://linkstar.com/) |
12 |
0.01% |
29.09.2009
16:16:22 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.11)
Gecko/20071127 Firefox/2.0.0.11 |
12 |
0.01% |
27.02.2010
09:08:40 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705;
MSIECrawler) |
11 |
0.01% |
26.12.2004
21:08:37 |
| ScSpider/0.2 |
11 |
0.01% |
13.09.2007
20:15:48 |
| geniebot (wgao@genieknows.com) |
11 |
0.01% |
24.11.2005
06:27:18 |
| Mozilla/3.0 (Compatible;Viking/1.9) (Viking/1.9) (prefetch) |
11 |
0.01% |
01.11.2007
07:45:07 |
| MJ12bot/v1.0.5 (http://majestic12.co.uk/bot.php?+) |
11 |
0.01% |
23.12.2005
22:29:01 |
| IlTrovatore-Setaccio/1.2 (Italy search engine;
http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) |
11 |
0.01% |
25.11.2005
10:11:44 |
| xirq/0.1-beta (xirq; http://www.xirq.com; xirq@xirq.com) |
11 |
0.01% |
16.12.2005
17:34:21 |
| NetResearchServer/4.0(loopimprovements.com/robot.html) |
11 |
0.01% |
21.01.2007
10:28:37 |
| schibstedsokbot (compatible; Mozilla/5.0; MSIE 5.0; FAST FreshCrawler
6; +http://www.schibstedsok.no/bot/) |
11 |
0.01% |
07.08.2007
12:29:14 |
| stalker/0.1 (http://www.stalkpire.de/bot.aspx) |
11 |
0.01% |
27.04.2007
23:37:08 |
| Nutch-test/Nutch-0.9-dev |
11 |
0.01% |
11.09.2006
07:17:38 |
| Snapbot/1.0 (+http://www.snap.com) |
11 |
0.01% |
20.06.2007
12:43:03 |
| Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot) |
11 |
0.01% |
10.07.2010
08:47:58 |
| Mozilla/5.0 (compatible; Synoobot/0.9;
http://www.synoo.com/search/bot.html) |
11 |
0.01% |
22.05.2007
01:27:17 |
| SeznamBot/1.0 (+http://fulltext2.seznam.cz/) |
11 |
0.01% |
01.09.2007
09:55:18 |
| holmes/3.11 (OnetSzukaj/5.0; +http://szukaj.onet.pl) |
11 |
0.01% |
12.12.2007
17:09:27 |
| Mozilla/5.0 (compatible; woriobot +http://worio.com) |
11 |
0.01% |
30.01.2010
10:43:11 |
| Python-urllib/1.17 |
11 |
0.01% |
12.03.2010
18:19:38 |
| SBIder/Nutch-1.0-dev (http://www.sitesell.com/sbider.html) |
11 |
0.01% |
08.05.2010
09:05:58 |
| crawly_2.6.3 (crawly@commandcom.com) |
11 |
0.01% |
10.06.2009
01:38:02 |
| Mozilla/5.0 (compatible; DBLBot/1.0; +http://www.dontbuylists.com/) |
11 |
0.01% |
21.07.2009
19:40:44 |
| Mozilla/5.0 (compatible; iCcrawler - iCjobs Stellenangebote Jobs;
http://www.icjobs.de) |
11 |
0.01% |
03.06.2010
23:48:57 |
| nutch.us/Nutch-1.0 (www.nutch.us; crawler@nutch.us) |
11 |
0.01% |
22.06.2009
11:53:45 |
| S2Bot/1.0 (http://search2.net) |
11 |
0.01% |
20.06.2010
20:49:33 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Internet Explorer
6.0 powered by Celos Computer GmbH; .NET CLR 1.0.3705; .NET CLR
1.1.4322; MSIECrawler) |
10 |
0.01% |
28.12.2004
14:27:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) |
10 |
0.01% |
02.10.2009
17:32:55 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
10 |
0.01% |
30.01.2005
22:11:55 |
| Crawler (cometsearch@cometsystems.com) |
10 |
0.01% |
21.06.2005
01:44:49 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-13.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
10 |
0.01% |
01.05.2005
09:25:05 |
| Mozilla/4.0 (compatible; grub-client-2.6.0) |
10 |
0.01% |
01.07.2005
04:48:28 |
| GOFORITBOT ( http://www.goforit.com/about/ ) |
10 |
0.01% |
04.07.2009
18:38:02 |
| Minuteman/0.4 |
10 |
0.01% |
03.10.2005
12:36:06 |
| NutchCVS/0.7 (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
10 |
0.01% |
23.11.2007
21:27:52 |
| Nutch Test/Something strange (Nutch Test; http://www.mistral.com) |
10 |
0.01% |
06.03.2007
14:55:47 |
| Mozilla/5.0 (compatible; heritrix/1.10.2 +http://i.stanford.edu/) |
10 |
0.01% |
06.06.2007
14:09:18 |
| boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) |
10 |
0.01% |
05.10.2008
15:36:38 |
| BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si;
spider@babaloo.si) |
10 |
0.01% |
02.07.2008
17:31:49 |
| Mozilla/5.0 (compatible; ApptusBot/1.0; +http://www.apptus.com) |
10 |
0.01% |
28.09.2009
22:08:49 |
| Mozilla/5.0 (compatible; OpenX Spider; http://www.openx.org) |
10 |
0.01% |
12.12.2008
15:18:11 |
| porn_viewer (larbin2.6.3@unspecified.mail) |
10 |
0.01% |
27.01.2009
03:30:53 |
| cn_net_viewer (larbin2.6.3@unspecified.mail) |
10 |
0.01% |
05.05.2009
12:37:05 |
| larbin_2.6.3 (myemail@address.co.uk) |
10 |
0.01% |
16.04.2010
04:19:02 |
| smart.apnoti.com Robot/v1.34
(http://smart.apnoti.com/index/aboutApnotiWebCrawler) |
10 |
0.01% |
21.07.2009
12:56:33 |
| 50.nu/0.01 ( +http://50.nu/bot.html ) |
10 |
0.01% |
02.09.2009
13:59:03 |
| Mozilla/5.0
(compatible;+ParchBot/1.0;++http://www.parchmenthill.com/search.htm) |
10 |
0.01% |
09.12.2009
03:31:27 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r
(Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130 |
10 |
0.01% |
15.12.2009
00:36:23 |
| page_test (larbin2.6.3@unspecified.mail) |
10 |
0.01% |
12.07.2010
03:45:52 |
| Mozilla/5.0 (compatible; MJ12bot/v1.3.1;
http://www.majestic12.co.uk/bot.php?+) |
10 |
0.01% |
02.01.2010
15:04:45 |
| binlar_2.6.3 (binlar2.6.3@unspecified.mail) |
10 |
0.01% |
02.08.2010
09:15:22 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0; obot) |
9 |
0.01% |
08.02.2010
04:01:45 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-2.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
9 |
0.01% |
01.08.2004
14:35:39 |
| LWP::Simple/5.76 |
9 |
0.01% |
31.01.2005
19:11:25 |
| Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html;
info@iltrovatore.it) |
9 |
0.01% |
12.01.2005
04:14:11 |
| Vagabondo/2.0 MT |
9 |
0.01% |
21.05.2005
03:57:07 |
| Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot
.php) |
9 |
0.01% |
24.08.2005
16:30:22 |
| oBot |
9 |
0.01% |
16.07.2009
20:00:31 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
Accept: */*
Accept-Language: en-us, en, de;q=0.50 |
9 |
0.01% |
26.04.2005
02:07:35 |
| Accoona-AI-Agent/1.1.1 (crawler at accoona dot com) |
9 |
0.01% |
22.08.2006
00:24:20 |
| findlinks/1.0.9 (+http://wortschatz.uni-leipzig.de/findlinks/) |
9 |
0.01% |
19.12.2005
06:23:11 |
| NutchCVS/0.8-dev (Nutch running at UW;
http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu) |
9 |
0.01% |
13.07.2006
12:53:58 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.10) Gecko/20050720
Fedora/1.0.6-1.1.fc3 Firefox/1.0.6 |
9 |
0.01% |
22.04.2006
06:45:15 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-16.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
9 |
0.01% |
16.07.2006
11:37:48 |
| psycheclone |
9 |
0.01% |
11.07.2006
20:09:31 |
| Firefox (kastaneta03@hotmail.com) |
9 |
0.01% |
02.10.2006
09:28:05 |
| MSRBOT (http://research.microsoft.com/research/sv/msrbot/) |
9 |
0.01% |
24.10.2008
04:31:23 |
| MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://falcon.cs.uiuc.edu;
mqbot@cs.uiuc.edu) |
9 |
0.01% |
30.01.2007
15:50:25 |
| onCHECK-Robot, www.onsearch.de |
9 |
0.01% |
11.08.2007
11:52:51 |
| MJ12bot/v1.1.2 (http://majestic12.co.uk/bot.php?+) |
9 |
0.01% |
15.02.2007
09:01:44 |
| CazoodleBot/0.1 (CazoodleBot Crawler; http://www.cazoodle.com;
mqbot@cazoodle.com) |
9 |
0.01% |
16.06.2007
19:43:23 |
| MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://vwbot.cs.uiuc.edu;
mqbot@cs.uiuc.edu) |
9 |
0.01% |
21.06.2007
20:04:44 |
| htdig/3.1.5 (unconfigured@htdig.searchengine.maintainer) |
9 |
0.01% |
20.06.2007
05:44:25 |
| Bigsearch.ca/Nutch-1.0-dev (Bigsearch.ca Internet Spider;
http://www.bigsearch.ca/; info@enhancededge.com) |
9 |
0.01% |
02.03.2008
05:30:59 |
| CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler;
http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) |
9 |
0.01% |
31.07.2007
00:45:22 |
| gonzo1[P] +http://www.suchen.de/faq.html |
9 |
0.01% |
15.06.2009
16:37:25 |
| holmes/3.12 (http://morfeo.centrum.cz/bot) |
9 |
0.01% |
29.11.2007
03:18:27 |
| Cityreview Robot (+http://www.cityreview.org/crawler/) |
9 |
0.01% |
30.05.2010
22:43:29 |
| NokiaN70/. FASTMobileCrawl/6.6 Profile/MIDP-2.0 Configuration/CLDC-1.1 |
9 |
0.01% |
26.01.2009
05:44:43 |
| Eurobot/1.0 (http://www.ayell.eu) |
9 |
0.01% |
06.11.2008
18:06:01 |
| ZipppBot/Nutch-0.9 (ZipppBot .02; http://www.zippp.net;
crawlteam@zippp.net) |
9 |
0.01% |
09.06.2008
20:24:54 |
| atraxbot/0.2 |
9 |
0.01% |
13.08.2009
23:11:16 |
| taptubot *** please read http://www.taptu.com/corp/taptubot *** |
9 |
0.01% |
01.06.2010
17:06:39 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.3; ips-agent)
Gecko/20090824 Fedora/1.0.7-1.1.fc4 Firefox/3.5.3 |
9 |
0.01% |
05.08.2010
05:22:46 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.9.2.3)
Gecko/20100401 Firefox/3.6.3 GTB7.0 (.NET CLR 3.5.30729) |
9 |
0.01% |
21.05.2010
10:44:23 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) |
8 |
0.01% |
23.10.2008
14:40:01 |
| Mozilla |
8 |
0.01% |
02.07.2010
07:08:33 |
| Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0
(compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) |
8 |
0.01% |
29.01.2009
20:03:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
8 |
0.01% |
20.03.2006
19:41:24 |
| W3C-checklink/4.2.1 [4.21] libwww-perl/5.803 |
8 |
0.01% |
16.10.2006
12:04:14 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Avant Browser;
MSIECrawler) |
8 |
0.01% |
10.05.2006
07:21:44 |
| NG-Search/0.90 (NG-SearchBot; http://www.ng-search.com; ) |
8 |
0.01% |
11.09.2006
22:05:48 |
| asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot
com) |
8 |
0.01% |
12.08.2006
06:32:31 |
| ilial/Nutch-0.9-dev |
8 |
0.01% |
21.10.2006
13:08:39 |
| ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot) |
8 |
0.01% |
21.07.2008
14:34:30 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727; MSIECrawler) |
8 |
0.01% |
16.08.2008
12:03:16 |
| Nutch0.9/Nutch-0.9-dev |
8 |
0.01% |
22.01.2007
15:35:21 |
| boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) |
8 |
0.01% |
31.10.2008
02:31:29 |
| Mozilla/5.0 (compatible; SkreemRBot +http://skreemr.com) |
8 |
0.01% |
14.12.2007
01:50:24 |
| Java/1.6.0_01-ea |
8 |
0.01% |
24.06.2007
11:06:52 |
| great-plains-web-spider/flatlandbot (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot.php;
jason@flatlandindustries.com) |
8 |
0.01% |
19.03.2008
05:29:09 |
| Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal :
Mishpat : עורכי דין :
חוק ומשפט
(hybridwse@runnk.com) |
8 |
0.01% |
23.02.2008
14:08:05 |
| EnaBot/1.2 (http://www.enaball.com/crawler.html) |
8 |
0.01% |
04.03.2008
06:47:47 |
| LTI/LemurProject Nutch Spider/Nutch-1.0-dev (lti crawler for CMU;
http://www.lti.cs.cmu.edu; changkuk at cmu dot edu) |
8 |
0.01% |
07.03.2008
13:21:21 |
| Mozilla/5.0 (compatible; heritrix/2.0.0 +http://www.mariamosolova.com) |
8 |
0.01% |
18.09.2008
08:21:23 |
| holmes/3.12.3 (http://morfeo.centrum.cz/bot) |
8 |
0.01% |
06.07.2008
03:26:05 |
| thumbshots-de-bot (+http://www.thumbshots.de) |
8 |
0.01% |
20.01.2009
22:44:18 |
| Mozilla/5.0 (compatible; heritrix/${pom.version} +http://seekda.com) |
8 |
0.01% |
29.10.2009
14:36:28 |
| ecxi/Nutch-1.0-dev (esCERT-UPC-ecxi; http://escert.upc.edu/; admin
escert edu) |
8 |
0.01% |
24.01.2009
14:50:37 |
| Runnk online rss reader : http://www.runnk.com/ : RSS favorites : RSS
ranking : RSS aggregator (support@runnk.com) |
8 |
0.01% |
23.11.2008
12:39:17 |
| Yandex/1.01.001 (compatible; Win16; m) |
8 |
0.01% |
12.04.2010
14:31:24 |
| Mozilla/5.0 (compatible; xrss; robot; http://www.xrss.eu/robot;
version 2.0) |
8 |
0.01% |
07.01.2010
15:38:32 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt) |
7 |
0.01% |
02.10.2009
17:32:55 |
| Amfibibot/0.06 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) |
7 |
0.01% |
23.04.2005
18:27:03 |
| CydralSpider/1.9 (Cydral Web Image Search; http://www.cydral.com) |
7 |
0.01% |
02.07.2005
22:48:02 |
| Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) |
7 |
0.01% |
19.11.2005
05:53:40 |
| Combine/2.0 |
7 |
0.01% |
24.06.2006
09:23:00 |
| eagle
Accept: */*
Accept-Language: en-us, en, de;q=0.50 |
7 |
0.01% |
07.08.2005
15:49:23 |
| Miva (AlgoFeedback@miva.com) |
7 |
0.01% |
21.03.2006
01:17:33 |
| BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com;
bot@bigclique.com) |
7 |
0.01% |
17.08.2005
14:55:17 |
| Gaisbot/3.0+(robot05@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/rob
ot.php) |
7 |
0.01% |
30.11.2005
03:49:11 |
| ichiro/2.0 (ichiro@nttr.co.jp) |
7 |
0.01% |
14.12.2005
13:19:47 |
| Exabot-Images/1.0 |
7 |
0.01% |
01.07.2006
01:18:02 |
| Mozilla/5.0 (compatible; Sokitomi crawl;
http://www.sokitomi.com/crawl.html; crawl@sokitomi.com) |
7 |
0.01% |
19.05.2006
08:49:01 |
| bot/1.0 |
7 |
0.01% |
15.05.2006
11:19:15 |
| WIRE/0.11 (Linux; i686;
Bot,Robot,Spider,Crawler,aromano@cli.di.unipi.it) |
7 |
0.01% |
02.06.2006
18:15:04 |
| Robo Crawler 6.4.5 (robocrawler@bb.softbank.co.jp) |
7 |
0.01% |
02.07.2006
23:10:24 |
| SiteSuBot |
7 |
0.01% |
15.06.2006
17:07:18 |
| Nutch0.8/Nutch-0.9-dev |
7 |
0.01% |
20.01.2007
17:44:09 |
| www.fi crawler, contact crawler@www.fi |
7 |
0.01% |
04.09.2007
21:24:13 |
| ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup
company. For more information please visit
http://www.ilial.com/crawler; http://www.ilial.com/crawler;
crawl@ilial.com) |
7 |
0.01% |
01.06.2007
20:45:26 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.14)
Gecko/20080404 Firefox/2.0.0.14 |
7 |
0.01% |
24.06.2008
08:58:12 |
| Runnk online rss reader : http://www.runnk.com/ : RSS favorites : RSS
ranking : RSS aggregator (hybridwse@runnk.com) |
7 |
0.01% |
16.10.2008
14:58:40 |
| ^Byte (http://CaretByte.com) |
7 |
0.01% |
24.07.2009
14:17:59 |
| SapphireWebCrawler/Nutch-1.0-dev (Sapphire Web Crawler using Nutch;
http://boston.lti.cs.cmu.edu/crawler/; mhoy@cs.cmu.edu) |
7 |
0.01% |
30.01.2009
03:53:37 |
| librabot/1.0 (+http://search.msn.com/msnbot.htm) |
7 |
0.01% |
25.08.2009
10:11:07 |
| YandexSomething/1.0 |
7 |
0.01% |
19.06.2009
09:52:15 |
| ssearch_bot/Nutch-1.0 (SSearch Crawler; http://www.semantissimo.de) |
7 |
0.01% |
04.08.2010
00:09:03 |
| linky |
7 |
0.01% |
02.08.2009
11:45:34 |
| Mozilla/5.0 (compatible; MJ12bot/v1.3.0;
http://www.majestic12.co.uk/bot.php?+) |
7 |
0.01% |
27.10.2009
03:02:31 |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; MSIECrawler) |
6 |
0.01% |
06.10.2005
18:36:18 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322) |
6 |
0.01% |
31.01.2006
04:02:07 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; MSIECrawler) |
6 |
0.01% |
30.03.2006
07:54:43 |
| wwwster/1.2 (Beta, mailto:gue@cis.uni-muenchen.de) |
6 |
0.01% |
14.10.2004
20:52:34 |
| Scooter/3.3 |
6 |
0.01% |
29.11.2005
13:02:59 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; MSIECrawler) |
6 |
0.01% |
23.05.2005
04:52:19 |
| Mozilla/5.0 (compatible; BecomeBot/1.23;
+http://www.become.com/webmasters.html) |
6 |
0.01% |
31.12.2004
10:49:36 |
| NutchCVS/0.06-dev (Nutch running at UW;
http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu) |
6 |
0.01% |
30.08.2005
18:32:18 |
| larbin_2.6.3 (n.sugandh@epfl.ch) |
6 |
0.01% |
05.07.2005
21:22:07 |
| OmniExplorer_Bot/2.93 (+http://www.omni-explorer.com) WorldIndexer |
6 |
0.01% |
26.07.2005
17:44:05 |
| WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com;
webindexerv1@yahoo.com) |
6 |
0.01% |
18.08.2005
21:59:24 |
| MJ12bot/v1.0.2 (http://majestic12.co.uk/bot.php?+) |
6 |
0.01% |
02.10.2005
19:04:22 |
| research-spider |
6 |
0.01% |
26.07.2006
09:53:09 |
| Forschungsportal/0.8-dev (Testinstallation;
http://www.forschungsportal.net/; fpcrawler@rrzn.uni-hannover.de) |
6 |
0.01% |
12.03.2006
19:24:45 |
| Mozilla/5.0 (compatible; heritrix/1.6.0 +http://www.schluetersche.de) |
6 |
0.01% |
25.06.2008
06:57:06 |
| Mozilla/5.0 (X11; U; Linux i686; rv:1.8.0.4) Gecko/20060602 |
6 |
0.01% |
04.07.2006
23:34:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; MSIECrawler) |
6 |
0.01% |
12.01.2007
14:38:00 |
| dragonfly(ebingbong@playstarmusic.com) |
6 |
0.01% |
25.08.2006
21:10:21 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.5)
Gecko/20060719 Firefox/1.5.0.5 |
6 |
0.01% |
02.08.2006
17:03:52 |
| Francis/2.0 (francis@neomo.de http://www.neomo.de/pages/crawler.php) |
6 |
0.01% |
23.08.2007
11:55:23 |
| search.ch V1.4.2 (http://www.search.ch) |
6 |
0.01% |
31.07.2008
01:29:11 |
| Steeler/3.2 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
6 |
0.01% |
10.01.2007
15:16:08 |
| NutchEC2Test/Nutch-0.9-dev (Testing Nutch on Amazon EC2.;
http://lucene.apache.org/nutch/bot.html; ec2test at lucene.com) |
6 |
0.01% |
27.10.2006
04:52:25 |
| iaskspider2 (iask@staff.sina.com.cn) |
6 |
0.01% |
07.11.2006
15:10:57 |
| complex_network_group/Nutch-0.9-dev (discovering the structure of the
world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl;
nimakhaj@gmail.com) |
6 |
0.01% |
22.02.2007
20:23:35 |
| ICCrawler - ICjobs (http://www.icjobs.de/bot.htm) |
6 |
0.01% |
22.06.2008
05:51:09 |
| Mozilla/5.0 (compatible; OsO; http://oso.octopodus.com/abot.html) |
6 |
0.01% |
13.03.2009
21:00:01 |
| Pluggd/Nutch-0.9 (automated crawler; http://www.pluggd.com; support at
pluggd dot com) |
6 |
0.01% |
05.10.2007
18:44:24 |
| multicrawler (+http://sw.deri.org/2006/04/multicrawler/robots.html) |
6 |
0.01% |
23.07.2008
15:09:16 |
| disco/Nutch-0.9 (experimental crawler ... please email
imagine@gmail.com if problems observed; imagine@gmail.com) |
6 |
0.01% |
07.09.2007
20:37:23 |
| LTI/LemurProject Nutch Spider/Nutch-1.0-dev (Research spider using
Nutch; http://www.lemurproject.org; mhoy@cs.cmu.edu) |
6 |
0.01% |
01.02.2008
19:06:42 |
| Semager/1.2 (http://www.semager.de/blog/semager-bots/) |
6 |
0.01% |
21.04.2008
02:50:02 |
| yoofind/yoofind-0.1-dev (yoono webcrawler; http://www.yoono.com ;
crawl@yoono.com) |
6 |
0.01% |
19.05.2008
10:52:41 |
| MySearch/Nutch-0.9 |
6 |
0.01% |
02.11.2008
22:30:53 |
| beast/Nutch-0.9 (agentspider; beast@mail.com) |
6 |
0.01% |
03.01.2009
16:20:01 |
| Webcrawler/Nutch-1.0-dev (Test crawl; lucene.apache.org/nutch/;
a@b.net) |
6 |
0.01% |
07.05.2009
08:28:44 |
| OOZBOT/0.20 ( -- ; http://www.setooz.com/oozbot.html ; agentname at
setooz dot_com ) |
6 |
0.01% |
10.06.2009
02:27:38 |
| DealGates Bot/1.1 by Luc Michalski
(http://spider.dealgates.com/bot.html) |
6 |
0.01% |
07.05.2009
06:32:38 |
| Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.8.1.16) Gecko/20080702
Iceweasel/2.0.0.16 (Debian-2.0.0.16-0etch1) |
6 |
0.01% |
24.04.2009
15:56:05 |
| LinguaBot/v0.001-dev (MultiLinual Sarch Engine v0.001; LinguaSeek;
admin at linguaseek dot com) |
6 |
0.01% |
07.09.2009
05:25:57 |
| blackcrawl/Nutch-0.9 (crawl for fun; www.zipfelchappe.com;
zipfelchappe@localhost) |
6 |
0.01% |
23.06.2009
21:40:12 |
| copyright sheriff (+http://www.copyrightsheriff.com/) |
6 |
0.01% |
25.03.2010
01:52:43 |
| kalooga/KaloogaBot (Kalooga;
http://www.kalooga.com/info.html?page=crawler) |
6 |
0.01% |
02.06.2009
18:54:23 |
| OOZBOT/0.20 ( http://www.setooz.com/oozbot.html ; agentname at setooz
dot_com ) |
6 |
0.01% |
16.11.2009
10:10:56 |
| Mozilla/5.0 (compatible; heritrix/${pom.version}
+http://www.adsafemedia.com) |
6 |
0.01% |
09.09.2009
13:55:46 |
| Orgbybot/OrgbyBot v1.2 (Spidering the net for Orgby;
http://www.orgby.com/ ; Orgby.com Search Engine) |
6 |
0.01% |
20.12.2009
07:45:54 |
| ichiro/4.0 (http://help.goo.ne.jp/door/crawler.html) |
6 |
0.01% |
16.06.2010
00:19:42 |
| msnbot/2.0b (+http://search.msn.com/msnbot.htm)._ |
6 |
0.01% |
30.05.2010
01:16:56 |
| SheenBot/SheenBot-1.0.4 (Sheen web crawler) |
6 |
0.01% |
31.07.2010
22:36:20 |
| GeoHasher/Nutch-1.0 (GeoHasher Web Search Engine;
geohasher.gotdns.org; geo_hasher at yahoo * com) |
6 |
0.01% |
16.08.2010
17:56:35 |
| Mozilla/5.0 (compatible; discobot/1.1;
+http://discoveryengine.com/discobot.html |
6 |
0.01% |
09.07.2010
00:19:39 |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker
(wn.zyborg@looksmart.net; http://www.WISEnutbot.com) |
5 |
0.01% |
06.05.2004
22:46:36 |
| Mozilla/4.0 (Windows XP 5.1) |
5 |
0.01% |
28.05.2005
10:25:23 |
| LinkWalker |
5 |
0.01% |
19.05.2006
15:47:02 |
| ObjectsSearch/0.01 (ObjectsSearch;
http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com) |
5 |
0.01% |
02.07.2004
19:18:32 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-1.zyborg@looksmart.net;
http://www.WISEnutbot.com) |
5 |
0.01% |
15.06.2004
03:45:04 |
| NutchCVS/0.05-dev (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net) |
5 |
0.01% |
24.08.2004
22:04:24 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt; 1u1ie4) |
5 |
0.01% |
23.08.2004
06:59:54 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; FunWebProducts;
MSIECrawler) |
5 |
0.01% |
06.05.2005
19:12:20 |
| Faxobot/1.0 |
5 |
0.01% |
12.12.2004
06:03:10 |
| Francis/2.0 (francis@neomo.de http://www.neomo.de/) |
5 |
0.01% |
01.08.2006
08:13:12 |
| ConveraCrawler/0.4 |
5 |
0.01% |
19.01.2005
21:56:15 |
| larbin_2.6.3 (webmaster@netzhoehle.de) |
5 |
0.01% |
16.02.2005
11:58:57 |
| Java/1.4.2_05 |
5 |
0.01% |
29.11.2005
22:59:13 |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT) |
5 |
0.01% |
21.08.2009
09:40:10 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows XP) Opera 6.01 [de] |
5 |
0.01% |
07.06.2005
23:14:18 |
| btbot/0.4 (+http://www.btbot.com/btbot.html) |
5 |
0.01% |
15.01.2006
22:49:59 |
| MJ12bot/v1.0.1 (http://majestic12.co.uk/bot.php?+) |
5 |
0.01% |
01.09.2005
01:37:17 |
| NaverBot-1.0 (NHN Corp. / +82-2-3011-1989 / nhnbot@naver.com) |
5 |
0.01% |
30.10.2005
02:28:34 |
| versus crawler from eda.baykan@epfl.ch |
5 |
0.01% |
30.07.2005
15:29:29 |
| findlinks/0.976 (+http://wortschatz.uni-leipzig.de/findlinks/) |
5 |
0.01% |
29.09.2005
17:38:41 |
| Metaspinner/0.01 (Metaspinner; http://www.meta-spinner.de/;
support@meta-spinner.de/) |
5 |
0.01% |
16.05.2009
13:52:44 |
| genieBot ((http://64.5.245.11/faq/faq.html)) |
5 |
0.01% |
06.06.2006
23:23:56 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
5 |
0.01% |
13.04.2006
11:12:30 |
| NutchCVS/0.7.1 (Nutch running at UW;
http://www.nutch.org/docs/en/bot.html; sycrawl@cs.washington.edu) |
5 |
0.01% |
30.03.2006
19:09:51 |
| virus_detector (virus_harvester@securecomputing.com) |
5 |
0.01% |
23.10.2006
21:57:44 |
| Pico 1.0.1 (http://pico.ofdan.com) |
5 |
0.01% |
24.07.2006
18:49:51 |
| Mozilla/5.0 (compatible;archive.org_bot/1.7.1; collectionId=316;
Archive-It; +http://www.archive-it.org) |
5 |
0.01% |
17.06.2006
06:14:31 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
5 |
0.01% |
19.07.2006
19:24:57 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727; .NET CLR 1.1.4322; MSIECrawler) |
5 |
0.01% |
23.09.2007
16:48:16 |
| ozelot/2.7.3 (Search engine indexer; www.flying-cat.de/ozelot;
ozelot@flying-cat.de) |
5 |
0.01% |
15.09.2006
10:22:01 |
| Mozilla/4.0 (compatible; MSIE 6.0) |
5 |
0.01% |
09.07.2007
06:59:20 |
| Cazoodle/Nutch-0.9-dev (Cazoodle Nutch Crawler;
http://www.cazoodle.com; mqbot@cazoodle.com) |
5 |
0.01% |
26.10.2006
05:01:44 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
5 |
0.01% |
21.10.2006
14:53:05 |
| Mozilla/4.0 (compatible; MyFamilyBot/1.0;
http://www.ancestry.com/learn/bot.aspx) |
5 |
0.01% |
17.10.2006
17:14:18 |
| Mozilla/5.0 (compatible; MSIE 6.0; Linux) |
5 |
0.01% |
22.10.2006
17:10:36 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1) Gecko/20061010
Firefox/2.0 |
5 |
0.01% |
11.11.2006
16:59:28 |
| Mozilla/4.0 (compatible; MSIE 6.0; Winodws NT 5.0) |
5 |
0.01% |
18.01.2007
10:23:29 |
| Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.1; DAUM Web Robot;
Daum Communications Corp., Korea) |
5 |
0.01% |
21.03.2007
04:28:25 |
| lwp-trivial/1.41 |
5 |
0.01% |
21.04.2007
16:59:46 |
| thumbshots-de-Bot (Version: 1.11, powered by www.thumbshots.de) |
5 |
0.01% |
02.10.2007
20:07:50 |
| Gigabot/2.0att |
5 |
0.01% |
21.07.2007
17:05:28 |
| Nutch/Nutch-0.8.1 (Nutch; Nutch; Nutch) |
5 |
0.01% |
19.02.2008
03:13:13 |
| Sirketcebot/v.01 (http://www.sirketce.com/bot.html) |
5 |
0.01% |
13.07.2007
14:26:52 |
| kalooga/Nutch-0.9 |
5 |
0.01% |
19.09.2007
03:31:57 |
| AOL_Ian_The_Aussie_Spider/Nutch-0.9 (Demo Thing; Ian@Holsman.net) |
5 |
0.01% |
11.11.2007
08:01:39 |
| DjangoTraineeBot/0.2 |
5 |
0.01% |
20.10.2007
11:47:24 |
| Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal :
Mishpat : &^x5e2;&^x5d5;&^x5e8;&^x5db;&^x5d9; &^x5d3;&^x5d9;&^x5df; :
&^x5d7;&^x5d5;&^x5e7; &^x5d5;&^x5de;&^x5e9;&^x5e4;&^x5d8;
(hybridwse@runnk.com) |
5 |
0.01% |
16.01.2008
18:12:58 |
| Python-urllib/2.5 |
5 |
0.01% |
19.06.2009
07:58:02 |
| OpenPlaces/Nutch-1.0-dev (OpenPlaces Content Crawler;
http://www.openplace.com; dnadeau at openplaces.com) |
5 |
0.01% |
02.04.2008
14:44:18 |
| exooba/exooba crawler (exooba; exooba) |
5 |
0.01% |
30.05.2008
23:26:45 |
| Acoon-Robot 4.0.2 (http://www.acoon.de) |
5 |
0.01% |
03.05.2008
15:51:32 |
| wauuu engine/Wauuu 0.1 (wauuu engine; http://www.wauuu.com;
wauuu@wauuu.com) |
5 |
0.01% |
11.06.2008
13:14:31 |
| Touche (+http://www.touche.com.ve) |
5 |
0.01% |
02.07.2009
14:27:55 |
| DotBot/1.0.1 (http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org) |
5 |
0.01% |
22.08.2008
13:50:26 |
| kalooga/KaloogaBot (Kalooga; http://www.kalooga.com; info@kalooga.com) |
5 |
0.01% |
16.09.2008
22:43:03 |
| Mozilla/5.0 (compatible; Butterfly/1.0;
+http://labs.topsy.com/butterfly.html) Gecko/2009032608 Firefox/3.0.8 |
5 |
0.01% |
06.05.2009
01:26:25 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; ru; rv:1.9.0.5)
Gecko/2008120122 Firefox/3.0.5 |
5 |
0.01% |
18.05.2009
02:56:30 |
| us_net_viewer (larbin2.6.3@unspecified.mail) |
5 |
0.01% |
06.05.2009
12:23:43 |
| es_net_viewer (larbin2.6.3@unspecified.mail) |
5 |
0.01% |
28.04.2009
05:42:46 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)/Nutch-1.0 |
5 |
0.01% |
24.06.2009
19:23:20 |
| yacybot (amd64 Linux 2.6.18-6-amd64; java 1.5.0_14; Europe/de)
http://yacy.net/bot.html |
5 |
0.01% |
07.11.2009
14:48:16 |
| gh-index-bot/Nutch-1.0 (GH Web Search.; lucene.apache.org; gh_email at
someplace dot com) |
5 |
0.01% |
14.08.2009
13:52:13 |
| LWP::Simple/5.827 libwww-perl/5.829 |
5 |
0.01% |
29.08.2009
20:42:03 |
| li_viewer (larbin2.6.3@unspecified.mail) |
5 |
0.01% |
01.08.2009
18:01:47 |
| Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98) |
5 |
0.01% |
24.10.2009
13:15:11 |
| amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.831 |
5 |
0.01% |
05.07.2010
20:28:29 |
| Mozilla/5.0 [Internet Explorer] |
5 |
0.01% |
23.03.2010
15:28:03 |
| Iceweasel2.0.0.16/Nutch-1.1 (Webbrowser; http://iceweasel.com;
info@iceweasel.com) |
5 |
0.01% |
21.06.2010
14:46:03 |
| Tipiweb/Nutch-1.0 (http://www.tipiweb.net) |
5 |
0.01% |
12.06.2010
09:46:49 |
| Mozilla/5.0 ( compatible; SETOOZBOT/0.30 ;
http://www.setooz.com/bot.html ) |
5 |
0.01% |
08.08.2010
09:27:05 |
| FAST-WebCrawler/3.8 (crawler at trd dot overture dot com;
http://www.alltheweb.com/help/webmaster/crawler) |
4 |
0% |
13.04.2004
08:10:29 |
| Openfind data gatherer,
Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.t
w/robot.html) |
4 |
0% |
20.07.2005
22:08:56 |
| NPBot (http://www.nameprotect.com/botinfo.html) |
4 |
0% |
25.11.2004
17:16:08 |
| Vagabondo/2.0 MT (webagent at wise-guys dot nl) |
4 |
0% |
05.01.2005
21:32:27 |
| Steeler/2.0 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
4 |
0% |
03.06.2004
07:30:13 |
| Mozilla/4.0 (compatible; Synapse) |
4 |
0% |
20.06.2005
20:20:48 |
| Seekbot/1.0 (http://www.seekbot.net/bot.html) RobotsTxtFetcher/1.0
(XDF) |
4 |
0% |
07.08.2004
20:37:11 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) |
4 |
0% |
28.03.2005
12:59:55 |
| Mozilla/5.0 (Slurp/si; slurp@inktomi.com;
http://www.inktomi.com/slurp.html) |
4 |
0% |
14.09.2004
11:39:45 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.4.1) Gecko/20020508
Netscape6/6.2.3 |
4 |
0% |
24.05.2005
21:35:29 |
| Mozilla/5.0 |
4 |
0% |
03.04.2008
04:22:27 |
| CreativeCommons/0.06-dev (Nutch;
http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net) |
4 |
0% |
07.10.2005
08:13:26 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.5)
Gecko/20041108 Firefox/1.0 |
4 |
0% |
31.03.2005
08:52:08 |
| Mozilla/4.0 (compatible; grub-client-2.3) |
4 |
0% |
20.01.2005
09:24:06 |
| http://www.istarthere.com (spider@istarthere.com) |
4 |
0% |
30.01.2005
21:20:45 |
| thesubot-beta-www.thesubot.de |
4 |
0% |
14.02.2005
03:06:27 |
| Mozilla/5.0 (Windows XP; U) Opera 6.01 [en]" |
4 |
0% |
11.05.2005
11:47:43 |
| versus crawler eda.baykan@epfl.ch |
4 |
0% |
28.05.2005
10:18:07 |
| Steeler/3.1 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
4 |
0% |
26.04.2006
19:05:04 |
| findlinks/0.903 (+http://wortschatz.uni-leipzig.de/findlinks/) |
4 |
0% |
02.05.2005
07:21:34 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.7)
Gecko/20050414 Firefox/1.0.3 |
4 |
0% |
07.05.2005
16:34:45 |
| Mozilla/5.0 (OS/2; U; Warp 4.5; en-US; rv:0.9.8) Gecko/20020204 |
4 |
0% |
28.05.2005
10:49:20 |
| Mozilla/4.61 [en] (OS/2; U) |
4 |
0% |
04.06.2005
03:14:58 |
| Mozilla/4.75 [en] (X11; U; SunOS 5.8 sun4u) |
4 |
0% |
17.06.2005
02:56:40 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Maxthon; .NET
CLR 1.1.4322; MSIECrawler) |
4 |
0% |
01.11.2005
14:29:53 |
| unido-bot, http://mobicom.cs.uni-dortmund.de/bot.html |
4 |
0% |
21.02.2006
23:34:47 |
| INGRID/3.0 MT (webcrawler@NOSPAMexperimental.net;
http://webmaster.ilse.nl/jsp/webmaster.jsp) |
4 |
0% |
07.10.2005
06:39:52 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) 1Noonbot 1.0
mailto:Sc_1noonbot@1nooncorp.com |
4 |
0% |
30.07.2005
18:17:58 |
| OmniExplorer_Bot/2.35 (+http://www.omni-explorer.com) WorldIndexer |
4 |
0% |
13.07.2005
18:43:00 |
| Omnipelagos.com RSS Spider 0.3 |
4 |
0% |
25.08.2005
06:42:28 |
| Searchmee! Spider v0.98a |
4 |
0% |
14.07.2009
18:16:47 |
| findlinks/0.966 (+http://wortschatz.uni-leipzig.de/findlinks/) |
4 |
0% |
15.09.2005
19:42:17 |
| Mozilla/4.0 (compatible; GPU p2p crawler
http://gpu.sourceforge.net/search_engine.php) |
4 |
0% |
29.10.2005
12:39:32 |
| stalker/0.1 (http://www.stalkpire.org/bot.htm) |
4 |
0% |
23.08.2006
14:11:01 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Telekom Austria;
FunWebProducts; Hotbar 4.5.1.0; MSIECrawler) |
4 |
0% |
05.07.2007
19:31:13 |
| DoCoMo/2.0 P900i(c100;TB;W24H11) |
4 |
0% |
22.08.2008
17:44:49 |
| findlinks/1.0 (+http://wortschatz.uni-leipzig.de/findlinks/) |
4 |
0% |
05.11.2005
16:53:24 |
| Mozdex/0.7.2-dev (Mozdex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
4 |
0% |
15.02.2006
23:36:16 |
| IlTrovatore-Setaccio/1.2 (It search engine;
http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) |
4 |
0% |
02.11.2005
17:19:27 |
| Shim-Crawler |
4 |
0% |
14.11.2005
00:16:09 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.4.20-021stab028.17.777-enterprise; java 1.4.2_08; Europe/en) |
4 |
0% |
06.02.2006
13:01:22 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Media Center
PC 3.0; .NET CLR 1.0.3705; .NET CLR 1.1.4322; MSIECrawler) |
4 |
0% |
22.09.2007
09:53:22 |
| http://www.almaden.ibm.com/cs/crawler |
4 |
0% |
23.06.2006
14:20:09 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8) Gecko/20051111
Firefox/1.5 |
4 |
0% |
31.01.2006
20:32:10 |
| http://pressemitteilung.ws/ |
4 |
0% |
29.12.2006
09:10:42 |
| Mozilla/5.0 (compatible; Theophrastus/2.1;
+http://users.cs.cf.ac.uk/N.A.Smith/theophrastus.php) |
4 |
0% |
06.01.2006
18:01:13 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.0.3705) |
4 |
0% |
28.01.2006
06:42:07 |
| FAST Enterprise Crawler/6.4 (crawler@fast.no) |
4 |
0% |
24.03.2006
04:13:56 |
| sproose/0.1-alpha (sproose crawler; http://www.sproose.com/bot.html;
crawler@sproose.com) |
4 |
0% |
01.04.2006
19:45:00 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_06;
Europe/de) |
4 |
0% |
23.07.2006
19:30:33 |
| ccubee/3.5 |
4 |
0% |
05.10.2006
16:06:35 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.1) Gecko/20060124
Firefox/1.5.0.1 |
4 |
0% |
27.07.2006
12:09:45 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Naver Desktop
Search) |
4 |
0% |
07.07.2006
02:26:50 |
| Yeti |
4 |
0% |
08.06.2006
05:40:42 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.5) Gecko/20060731
Ubuntu/dapper-security Firefox/1.5.0.5 |
4 |
0% |
13.09.2006
15:26:31 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
4 |
0% |
31.10.2006
20:07:45 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.5) Gecko |
4 |
0% |
25.10.2006
16:28:27 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 2.0.50727; .NET CLR 1.1.4322; Media Center PC 4.0;
FDM; Media Center PC 3.0; MSIECrawler) |
4 |
0% |
01.01.2007
20:15:13 |
| Mozilla/5.0 (Mozilla@mail.com) |
4 |
0% |
06.01.2007
23:23:44 |
| NetWhatCrawler/0.06-dev (NetWhatCrawler from NetWhat.com;
http://www.netwhat.com; support@netwhat.com) |
4 |
0% |
31.05.2008
19:59:13 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727;
MSIECrawler) |
4 |
0% |
26.09.2007
16:55:04 |
| Touche |
4 |
0% |
25.04.2008
20:03:22 |
| ConveraCrawler/0.9e (+http://www.authoritativeweb.com/crawl) |
4 |
0% |
15.05.2007
18:13:21 |
| Mozilla/5.0 (compatible; Najdi.si/3.1) |
4 |
0% |
26.03.2007
12:08:11 |
| LarbinWebCrawler (internet@bredband.net) |
4 |
0% |
18.03.2007
10:39:01 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705) |
4 |
0% |
24.05.2007
18:17:57 |
| Twiceler-0.9 http://www.cuill.com/twiceler/robot.html |
4 |
0% |
23.04.2007
09:40:25 |
| Speedy Spider (Entireweb; Beta/1.2;
http://www.entireweb.com/about/search_tech/speedyspider/) |
4 |
0% |
09.05.2007
22:51:56 |
| Nutch/Nutch-0.9 |
4 |
0% |
09.08.2008
03:08:07 |
| ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html;
icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp) |
4 |
0% |
24.06.2007
03:44:52 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
http://www.changedetection.com/bot.html ) |
4 |
0% |
26.07.2007
00:22:52 |
| terraminds-bot/1.0 (support@terraminds.de) |
4 |
0% |
14.08.2007
16:16:46 |
| Mozilla/5.0 (compatible; Bot; +http://pressemitteilung.ws/spamfilter |
4 |
0% |
04.04.2008
13:07:36 |
| Teemer (NetSeer, Inc.; http://www.netseer.com/crawler.html;
crawler@netseer.com) |
4 |
0% |
18.11.2007
09:44:29 |
| Mozilla/4.0 (compatible; DAUMOA-video;
+http://ws.daum.net/aboutkr.html) |
4 |
0% |
13.12.2007
23:40:43 |
| EnaBot/1.1 (http://www.enaball.com/crawler.html) |
4 |
0% |
24.02.2008
18:28:43 |
| ThumbShots-Bot (+http://thumbshots.in/bot.html) |
4 |
0% |
06.04.2010
03:28:52 |
| LinkAider |
4 |
0% |
09.09.2008
13:58:00 |
| nrsbot/5.0(loopip.com/robot.html) |
4 |
0% |
23.05.2009
07:21:34 |
| Infohelfer/0.9 (http://www.infohelfer.de/) |
4 |
0% |
14.04.2008
16:41:51 |
| kalooga/kalooga-4.0-dev-datahouse (Kalooga; http://www.kalooga.com;
info@kalooga.com) |
4 |
0% |
21.04.2008
05:18:39 |
| Nutch/Nutch-0.9 (Eurobot; http://www.ayell.eu ) |
4 |
0% |
19.04.2008
16:55:50 |
| gokimabot |
4 |
0% |
13.05.2008
12:44:04 |
| MSR-ISRCCrawler |
4 |
0% |
20.05.2008
11:25:07 |
| MyEngines-Bot (Version: 1.01, powered by www.myengines.org) |
4 |
0% |
03.11.2008
21:29:17 |
| ZipppBot/Nutch-1.0-dev (ZipppBot .02; http://www.zippp.net;
crawlteam@zippp.net) |
4 |
0% |
22.06.2008
11:17:40 |
| htdig |
4 |
0% |
21.06.2008
17:59:25 |
| lmspider/Nutch-0.9-dev (For research purposes.; www.nuance.com) |
4 |
0% |
28.08.2008
03:38:57 |
| exooba crawler/0.5.1 (crawler for exooba.com; http://www.exooba.com/;
info at exooba dot com) |
4 |
0% |
27.07.2008
00:17:26 |
| gsa-crawler (Enterprise; S5-QCYPV6K3FUJAA; sysadmin@worldsoft.ch) |
4 |
0% |
09.10.2008
15:24:46 |
| Knight/0.2 (Zook Knight; http://knight.zook.in/; knight@zook.in) |
4 |
0% |
17.12.2008
06:28:05 |
| Jambot/0.1.1 (Jambot; http://www.jambot.com/blog; crawler@jambot.com) |
4 |
0% |
04.04.2009
21:36:38 |
| TooT/TooT-0.1-test (TooT crawler; http://www.toot.ch/blog/ueber-toot/;
crawler(at)toot(dot)ch) |
4 |
0% |
19.12.2008
02:54:12 |
| Test crawler Nutch/Nutch-1.0-dev (Nutch Test Project;
changkuk@cmu.edu) |
4 |
0% |
23.12.2008
04:55:15 |
| snookit/Snookit (domains@snookit.com) |
4 |
0% |
10.01.2009
11:20:14 |
| robotgenius (http://robotgenius.net) |
4 |
0% |
23.02.2010
11:19:45 |
| Peter Wang/Nutch-0.9 (Nutch spiderman;
http://peterpuwang.googlepages.com ; MyEmail) |
4 |
0% |
14.09.2009
01:10:53 |
| NutchCVS/Nutch-1.0 (http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
4 |
0% |
06.11.2009
07:36:00 |
| googleru_orgnet_viewer (larbin2.6.3@unspecified.mail) |
4 |
0% |
04.06.2009
21:22:55 |
| http://www.amagit.com/ |
4 |
0% |
09.02.2010
05:41:36 |
| Wget/1.11.1 |
4 |
0% |
25.06.2010
21:46:11 |
| eChooseBot/1 |
4 |
0% |
30.08.2009
18:39:52 |
| Java/1.6.0_07 |
4 |
0% |
18.02.2010
02:01:46 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_17; Europe/de)
http://yacy.net/bot.html |
4 |
0% |
20.03.2010
10:52:05 |
| librabot/2.0 (+http://academic.research.microsoft.com/) |
4 |
0% |
04.12.2009
19:45:37 |
| Linguee Bot (http://www.linguee.com/bot; bot@linguee.com) |
4 |
0% |
26.03.2010
00:51:45 |
| Yummy-Peach/YummyPeach-1.0 (Linux x86_64; en-US; rv:1.0.0.0;
http://www.yummypeach.com/info.html; support@yummypeach.com) |
4 |
0% |
12.03.2010
21:00:19 |
| university/Nutch-1.0 (research) |
4 |
0% |
14.03.2010
11:01:52 |
| Mozilla/5.0 (compatible; Semager/1.4;
http://www.semager.de/blog/semager-bots/) |
4 |
0% |
21.06.2010
00:59:46 |
| url_test (larbin2.6.3@unspecified.mail) |
4 |
0% |
26.05.2010
08:39:08 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.3)
Gecko/20100401 Firefox/3.6.3 |
4 |
0% |
18.06.2010
13:25:50 |
| CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com) |
4 |
0% |
22.06.2010
08:35:55 |
| Mozilla/5.0 (compatible; spbot/2.0.3; +http://www.seoprofiler.com/bot/
) |
4 |
0% |
01.06.2010
12:50:07 |
| SexShop.Sg/Nutch-1.1 (www.SexShop.Sg; crawler@SexShop.Sg) |
4 |
0% |
21.07.2010
20:42:16 |
| Wget/1.9+cvs-stable (Red Hat modified) |
4 |
0% |
20.08.2010
23:05:55 |
| mozDex/0.04-dev (mozDex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
3 |
0% |
21.06.2004
11:08:40 |
| NutchCVS/0.03-dev (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net) |
3 |
0% |
27.10.2005
11:50:35 |
| Iltrovatore-Setaccio/0.3-dev (Indexing;
http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
3 |
0% |
15.04.2004
12:51:06 |
| WebFilter Robot 1.0 |
3 |
0% |
29.09.2004
19:14:45 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de-DE; rv:1.6) Gecko/20040210
Firefox/0.8 |
3 |
0% |
27.04.2004
22:46:00 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90;
MSIECrawler) |
3 |
0% |
23.05.2006
15:01:31 |
| IlTrovatore-Setaccio/1.2 (Indexing;
http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) |
3 |
0% |
16.07.2004
12:53:03 |
| GeonaBot/1.1; http://www.geona.com/ |
3 |
0% |
04.03.2005
13:06:23 |
| boitho.com-dc/0.51 ( http://www.boitho.com/dcbot.html ) |
3 |
0% |
22.07.2004
12:35:14 |
| ObjectsSearch/0.05 (ObjectsSearch;
http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com) |
3 |
0% |
04.08.2004
07:51:55 |
| Java/1.4.2_04 |
3 |
0% |
28.01.2005
23:42:36 |
| pipeLiner/0.3a (PipeLine Spider;
http://www.pipeline-search.com/webmaster.html;
webmaster@pipeline-search.com) |
3 |
0% |
11.01.2005
19:05:38 |
| Wget/1.8.2 |
3 |
0% |
07.08.2005
17:10:58 |
| Yahoo-MMAudVid/1.0 (mms dash mmaudvidcrawler dash support at yahoo
dash inc dot com) |
3 |
0% |
24.02.2005
04:54:43 |
| Digger/2.0 JDK/1.4.2 |
3 |
0% |
08.05.2006
23:06:58 |
| eventax/1.3 (eventax; http://www.eventax.de/; info@eventax.de) |
3 |
0% |
20.12.2007
09:49:41 |
| Mozilla/5.0 (compatible; Yahoo! Slurp/si-emb;
http://help.yahoo.com/help/us/ysearch/slurp) |
3 |
0% |
23.05.2006
10:43:29 |
| NP/0.1 (NP; http://www.nameprotect.com; npbot@nameprotect.com) |
3 |
0% |
19.03.2005
12:24:05 |
| Mozilla/4.0 (compatible; SpeedySpider; www.entireweb.com) |
3 |
0% |
27.03.2005
16:55:54 |
| Mozilla/5.0 (compatible; BecomeBot/1.83; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
3 |
0% |
26.04.2005
02:10:14 |
| Mozdex/0.06-dev (Mozdex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
3 |
0% |
25.04.2005
11:27:00 |
| MicroBaz |
3 |
0% |
16.06.2005
19:35:35 |
| DataparkSearch/4.30-04052005 (+http://www.dataparksearch.org/) |
3 |
0% |
20.05.2005
11:58:19 |
| pipeLiner/0.12 (PipeLine Spider;
http://www.pipeline-search.com/webmaster.html) |
3 |
0% |
21.07.2005
08:47:14 |
| W3C-checklink/4.2 [4.20] libwww-perl/5.803 |
3 |
0% |
30.07.2005
19:16:59 |
| Mozilla/5.0 (compatible; BecomeBot/1.86; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
3 |
0% |
24.05.2005
18:08:07 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0) |
3 |
0% |
17.08.2005
09:07:57 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
Accept: */*
Accept-Language: en-us, en, de;q=0.50 |
3 |
0% |
04.06.2005
09:18:20 |
| NutchCVS/0.70-dev-mnebel-20050219 (Netluchs; http://www.netluchs.de/;
nutch-agent@netluchs.de) |
3 |
0% |
02.07.2005
02:23:31 |
| ccubee/3.0 |
3 |
0% |
05.07.2005
12:19:46 |
| Seekbot/2.x |
3 |
0% |
05.09.2005
02:06:27 |
| Onet.pl SA, http://szukaj.onet.pl |
3 |
0% |
24.07.2005
09:13:25 |
| sna-0.0.1 (mikeelliott@hotmail.com) |
3 |
0% |
12.07.2006
22:34:45 |
| ccubee/3.1 |
3 |
0% |
15.07.2005
01:45:01 |
| libwww-perl/5.803 |
3 |
0% |
25.11.2005
15:31:25 |
| unknown (man@themoon.com) |
3 |
0% |
25.08.2005
23:02:03 |
| ZeBot_www.ze.bz (ze.bz@hotmail.com) |
3 |
0% |
15.10.2005
12:54:59 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.10)
Gecko/20050717 Firefox/1.0.6 |
3 |
0% |
23.09.2005
17:41:56 |
| OmniWeb |
3 |
0% |
21.02.2009
16:47:18 |
| iCCrawler (http://www.iccenter.net) |
3 |
0% |
15.10.2005
23:05:36 |
| NG-Search/0.85_(+http://www.ng-search.com) |
3 |
0% |
30.09.2005
11:57:03 |
| Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece) |
3 |
0% |
08.10.2006
10:29:43 |
| KFSW-Bot (Version: 1.01, powered by KFSW, www.kfsw.de) |
3 |
0% |
20.05.2008
13:58:02 |
| Shim Crawler |
3 |
0% |
23.10.2005
19:55:59 |
| ccubee/3.2 |
3 |
0% |
21.11.2005
23:01:40 |
| Blogpulse (info@blogpulse.com) |
3 |
0% |
30.10.2005
16:11:50 |
| RufusBot (Rufus Web Miner; http://64.124.122.252/feedback.html) |
3 |
0% |
01.11.2005
00:14:09 |
| Java/1.5.0_04 |
3 |
0% |
23.05.2006
08:21:25 |
| gonzo1[D] mailto:crawleradmin.t-info@telekom.de |
3 |
0% |
22.06.2006
19:13:08 |
| findlinks/1.1-a5 (+http://wortschatz.uni-leipzig.de/findlinks/) |
3 |
0% |
17.12.2005
01:00:02 |
| findlinks/1.1-a4 (+http://wortschatz.uni-leipzig.de/findlinks/) |
3 |
0% |
05.01.2006
01:12:25 |
| MJ12bot/v1.0.6 (http://majestic12.co.uk/bot.php?+) |
3 |
0% |
23.12.2005
16:37:23 |
| Alpha Search Agent |
3 |
0% |
10.01.2006
20:00:56 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322;
freenet.de frndial 5.0; MSIECrawler) |
3 |
0% |
26.01.2006
14:00:14 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1;
MSIECrawler) |
3 |
0% |
28.10.2006
10:59:56 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.6.8-022stab070.4-enterprise; java 1.5.0_06; Europe/en) |
3 |
0% |
29.04.2006
22:19:30 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.5); .NET
CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 3.1; Media Center PC
3.0) |
3 |
0% |
24.04.2006
04:05:56 |
| Randy |
3 |
0% |
27.05.2006
01:26:28 |
| topicblogs/0.9 |
3 |
0% |
30.06.2007
20:19:04 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
3 |
0% |
24.06.2006
20:49:44 |
| updated/0.1-alpha (updated crawler; http://www.updated.com;
crawler@updated.com) |
3 |
0% |
08.06.2006
19:15:04 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Alcohol
Search; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MSIECrawler) |
3 |
0% |
11.06.2006
19:51:46 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Wysigot 5.51;
.NET CLR 1.1.4322; .NET CLR 2.0.50727; MSIECrawler) |
3 |
0% |
23.06.2006
12:44:12 |
| W3C-checklink/4.2.1 [4.21] libwww-perl/5.805 |
3 |
0% |
01.07.2006
14:09:23 |
| BeijingCrawler |
3 |
0% |
28.07.2006
03:56:39 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; InfoPath.1; MSIECrawler) |
3 |
0% |
11.08.2007
21:18:09 |
| Szukacz/1.5 (robot; www.szukacz.pl/html/jak_dziala_robot.html;
info@szukacz.pl) |
3 |
0% |
14.02.2009
12:58:22 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.5)
Gecko/20060719 Firefox/1.5.0.5 |
3 |
0% |
02.08.2006
08:50:53 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.13-15.11-default; java
1.5.0_07; Europe/en) |
3 |
0% |
04.02.2007
13:01:19 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
3 |
0% |
18.08.2006
09:30:51 |
| Mozilla/5.0 (Windows; U; Windows NT 5.2; de; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
3 |
0% |
27.08.2006
14:35:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
3 |
0% |
17.09.2006
17:41:22 |
| Mozilla/5.0 (Windows;) NimbleCrawler 2.0.1 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
3 |
0% |
18.07.2007
09:25:35 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) () |
3 |
0% |
28.09.2009
18:33:03 |
| NG-Search/0.9.8 (NG-SearchBot; http://www.ng-search.com) |
3 |
0% |
28.09.2006
21:59:33 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727; .NET CLR 1.1.4322; FDM; MSIECrawler) |
3 |
0% |
10.10.2006
02:16:28 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 Mnenhy/0.7.4.666 |
3 |
0% |
10.10.2006
00:47:24 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1) Gecko/20060918
Firefox/2.0 |
3 |
0% |
05.10.2006
00:00:40 |
| gonzo1[P] +http://www.suchen.de/popups/faq.jsp |
3 |
0% |
07.10.2006
19:27:17 |
| silk/1.0 |
3 |
0% |
26.10.2006
00:52:55 |
| Combine/3 http://combine.it.lth.se/ |
3 |
0% |
28.08.2009
03:21:22 |
| hohotestbot/Nutch-0.8.1 (HOHO Test Bot (Nutch);
no.urlyetjustesting.com) |
3 |
0% |
17.03.2007
21:21:17 |
| ParaginSpider/Nutch-0.8.1 |
3 |
0% |
03.02.2007
01:05:24 |
| Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider;
http://www.bigsearch.ca/; info@enhancededge.com) |
3 |
0% |
02.02.2007
13:16:59 |
| OpenISearch/1.x (www.openisearch.com) |
3 |
0% |
26.01.2007
03:08:02 |
| StreamSzene Spider/Nutch-0.9 (Spider from StreamSzene.de;
bot@streamszene.de) |
3 |
0% |
10.05.2007
00:56:36 |
| alef/0.0 |
3 |
0% |
26.09.2008
19:12:17 |
| SygolBot http://www.sygol.com |
3 |
0% |
21.03.2010
13:40:59 |
| nokia6610I/1.0 (4.10) Profile/MIDP-1.0 Configuration/CLDC-1.0 (FAST
WAP Proxy/1.0) |
3 |
0% |
21.09.2007
17:37:12 |
| great-plains-web-spider/gpws (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot.php;
jason@flatlandindustries.com) |
3 |
0% |
01.07.2007
10:12:09 |
| ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup
company.; http://www.ilial.com/crawler; crawl@ilial.com) |
3 |
0% |
12.06.2007
07:15:04 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.2;
MSIECrawler) |
3 |
0% |
08.07.2008
23:06:57 |
| VWBOT/Nutch-0.9-dev (VWBOT Nutch Crawler; http://vwbot.cs.uiuc.edu;
vwbot@cs.uiuc.edu) |
3 |
0% |
12.07.2007
19:13:20 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; +http://process1.com)
Gecko/20070508 Firefox/1.5.0.12 |
3 |
0% |
06.09.2007
11:56:57 |
| Nokia6680/1.0 ((4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0
Configuration/CLDC-1.1 (for mobile crawler) ) |
3 |
0% |
17.08.2007
17:30:14 |
| TestCrawler/Nutch-0.9 (Testing Crawler for Research ;
http://chitchit.org/TestCrawler.html; amitjain at spro dot net) |
3 |
0% |
02.09.2007
12:24:51 |
| visit_www.realfrags.com (root@localhost) |
3 |
0% |
25.08.2007
07:06:33 |
| http://pressemitteilung.ws/spamfilter |
3 |
0% |
03.09.2007
13:23:41 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.6.0_02;
Europe/de) |
3 |
0% |
22.11.2007
23:12:32 |
| Pagebull http://www.pagebull.com/ |
3 |
0% |
24.12.2007
11:43:54 |
| disco/Nutch-0.9 (experimental crawler ... please email
imagine@gmail.com if problems observed; nedrocks@gmail.com) |
3 |
0% |
12.09.2007
17:58:49 |
| Robotgenius crawler/Nutch-1.0-dev (http://robotgenius.net; misc at
robotgenius dot net) |
3 |
0% |
06.12.2007
03:33:19 |
| disco/Nutch-0.9 (experimental crawler; nedrocks@gmail.com) |
3 |
0% |
22.09.2007
14:15:07 |
| Mozilla/4.0(compatible;MSIE5.00;Windows98) (mail_126_com@126.com) |
3 |
0% |
26.10.2007
06:39:03 |
| LinkWalker/2.0 |
3 |
0% |
24.09.2009
01:03:05 |
| Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1) |
3 |
0% |
28.09.2009
13:20:29 |
| Mozilla/5.0 (compatible; heritrix/1.12.0 +http://seekda.com) |
3 |
0% |
09.11.2007
13:41:45 |
| DjangoTraineeBot/0.1 |
3 |
0% |
17.10.2007
08:17:29 |
| woriobot (+http://www.worio.com/) |
3 |
0% |
22.11.2007
13:09:29 |
| Mozilla/5.0 (Windows;) NimbleCrawler 2.0.2 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
3 |
0% |
10.05.2008
00:56:20 |
| MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE;
Default) |
3 |
0% |
21.03.2008
19:43:54 |
| nutch 0.9/Nutch-1.0-dev |
3 |
0% |
22.11.2007
05:51:49 |
| Java/1.5.0_11 |
3 |
0% |
19.02.2008
22:43:23 |
| NutchCVS (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
3 |
0% |
26.02.2008
01:01:21 |
| Test/Nutch-0.9 |
3 |
0% |
10.02.2008
08:44:46 |
| nutchsearch/Nutch-0.9 (Nutch Search 1.0; herceg_novi at yahoo dot com) |
3 |
0% |
28.01.2008
05:03:38 |
| Runnk RSS aggregator : http://www.runnk.com/il/law Israeli legal
עורכי דין
חוק ומשפט
(hybridwse@runnk.com) |
3 |
0% |
02.02.2008
04:49:17 |
| Nutch/Nutch-0.9 (Nutch; http://nutch; nutch) |
3 |
0% |
01.03.2008
18:25:43 |
| IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/) |
3 |
0% |
20.04.2008
05:42:06 |
| nrsbot/5.02 |
3 |
0% |
23.03.2008
16:58:55 |
| Python-urllib/2.4 |
3 |
0% |
26.12.2009
19:23:49 |
| IIITBOT/1.1 (Indian Language Web Search Engine;
http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in) |
3 |
0% |
21.03.2009
08:06:25 |
| Opera/9.10 (Windows NT 5.0; U; de) (-) |
3 |
0% |
29.04.2008
08:34:16 |
| localSystem/Nutch-0.9 |
3 |
0% |
22.06.2008
20:10:02 |
| TestAgent/Nutch-0.9 (Test Agent; none; none) |
3 |
0% |
19.05.2008
05:34:27 |
| quaero.net/Nutch-0.9 (Quaero.net; http://www.quaero.net; contact at
quaero dot net) |
3 |
0% |
27.06.2008
03:11:01 |
| exooba crawler/exooba crawler (crawler for exooba.com;
http://www.exooba.com/; info at exooba dot com) |
3 |
0% |
12.06.2008
03:21:28 |
| QEAVis agent/Nutch-0.9 (http://nlp.uned.es/qeavis/) |
3 |
0% |
17.07.2008
18:40:39 |
| d1g |
3 |
0% |
19.08.2008
04:23:52 |
| OOZBOT/0.17 (--; http://www.setooz.com/oozbot.html; pvvpr at iiit dot
ac dot in) |
3 |
0% |
21.07.2008
16:52:45 |
| NetFarma/Nutch-0.9 (NetFarma; http://www.netfarma.ro;
admin@netfarma.ro) |
3 |
0% |
13.07.2008
08:52:19 |
| Runnk RSS aggregator: http://www.runnk.com/ : RSS favorites : RSS
ranking (hybridwse@runnk.com) |
3 |
0% |
02.09.2008
11:35:43 |
| uw_cse_xwci uw.crawler@gmail.com
http://chong.cs.washington.edu/index.html/Nutch-0.9 (University of
Washington Computer Science XWC project crawl;
http://chong.cs.washington.edu/index.html; uw dott crawler att g ---
mail ) |
3 |
0% |
25.08.2008
05:35:54 |
| FyberSpider/1.3 (http://www.fybersearch.com/fyberspider.php) |
3 |
0% |
19.07.2010
22:09:58 |
| Netluchs/Nutch-1.0-dev ( ; http://www.netluchs.de/;
_do_not_spam_me___humans_please_use_info_at_netluchs.de_without_the_da
sh) |
3 |
0% |
02.10.2008
15:47:44 |
| Horny Sex Search/Nutch-0.9 (HornySexSearch.com Crawler;
http://www.hornysexsearch.com; Contact HornySexSearch.com) |
3 |
0% |
26.11.2008
22:56:00 |
| Biglotron-3.01 (robot@too.org) |
3 |
0% |
21.09.2008
10:35:17 |
| mozilla/5.0 (compatible; RTGI; http://rtgi.fr/) |
3 |
0% |
22.12.2009
00:09:56 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.7)
Gecko/20050414 Firefox/1.0.3 |
3 |
0% |
18.08.2009
08:04:01 |
| iSearch/2.17 |
3 |
0% |
14.10.2008
20:24:19 |
| Intel/2008-10-02_04-01-48 (Nutch; http://lucene.apache.org/nutch/;
moc.letni@laev.e.nayrb) |
3 |
0% |
25.10.2008
12:30:53 |
| yacybot (x86 Windows Vista 6.0; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
3 |
0% |
19.05.2010
12:30:25 |
| beast/Nutch-1.0-dev (agentspider; beast@mail.com) |
3 |
0% |
05.11.2008
01:11:00 |
| www.spayorneuterasia.com (root@localhost) |
3 |
0% |
12.03.2010
22:49:50 |
| infometrics-bot, http://www.infometrics.de |
3 |
0% |
14.11.2008
10:25:14 |
| nutch_princeton/Nutch-1.0-dev (princeton crawler for cass project;
http://www.cs.princeton.edu/cass/; zhewang a_t cs ddot princeton dot
edu) |
3 |
0% |
01.12.2008
05:30:55 |
| robotgenius |
3 |
0% |
22.01.2009
19:36:57 |
| TestSpider/Nutch-1.0-dev |
3 |
0% |
03.02.2009
12:28:34 |
| Mozilla/5.0 (compatible; WebmasterCoffee/0.7;
+http://webmastercoffee.com/about) |
3 |
0% |
30.08.2009
06:44:36 |
| Opera/9.10 (Windows NT 5.1; U; en) |
3 |
0% |
04.03.2009
15:13:04 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8) Gecko/20051107
Firefox/1.5 |
3 |
0% |
08.03.2010
13:21:02 |
| hitcrawler_0.1 (ringken@gmail.com) |
3 |
0% |
23.02.2010
07:58:11 |
| Bubbleclub Search Agent/Nutch-0.9 (Bubbleclub spiderman;
http://www.bubbleclub.de ; MyEmail) |
3 |
0% |
02.04.2009
00:05:46 |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0) |
3 |
0% |
02.12.2009
10:47:09 |
| OpenAcoon v4.1.0 (www.openacoon.de) |
3 |
0% |
14.02.2010
10:08:33 |
| Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.3) Gecko/2008092814
Iceweasel/3.0.3 (Debian-3.0.3-3) |
3 |
0% |
18.12.2009
17:14:23 |
| Mozilla/5.0
(compatible;YodaoBot-Image/1.0;http://www.youdao.com/help/webmaster/sp
ider/;) |
3 |
0% |
08.08.2009
19:57:18 |
| Goldfire Server |
3 |
0% |
09.04.2010
16:41:06 |
| Isara/Isara-1.0 (A non-profit search engine for the benefit of
charity.; http://www.isara.org; search@isara.org) |
3 |
0% |
03.11.2009
22:21:56 |
| SheenBot/SheenBot-1.0.0 (Sheen web crawler) |
3 |
0% |
19.11.2009
19:17:37 |
| Schloerbot/Nutch-1.0 (Schloer consulting bot;
http://schloerconsulting.com/schloerbot) |
3 |
0% |
27.10.2009
10:03:29 |
| yacybot (i386 Linux 2.6.28-16-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
3 |
0% |
20.11.2009
22:26:45 |
| Mozilla/5.0 (compatible; Plukkie/1.2;
http://www.botje.com/plukkie.htm) |
3 |
0% |
09.01.2010
07:18:41 |
| SheenBot/SheenBot-1.0.2 (Sheen web crawler) |
3 |
0% |
01.01.2010
16:23:42 |
| Comodo-Certificates-Spider |
3 |
0% |
23.02.2010
14:42:37 |
| Mozilla/5.0 (compatible; aiHitBot/1.0-DS; +http://www.aihit.com/) |
3 |
0% |
30.04.2010
00:33:09 |
| UberaSiteExplorer/UberaSiteExplorer-1.0 |
3 |
0% |
26.01.2010
08:01:17 |
| BrightEdge Crawler/1.0 (crawler@brightedge.com) |
3 |
0% |
12.02.2010
00:03:23 |
| Mozilla/5.0 (compatible; Plukkie/1.3;
http://www.botje.com/plukkie.htm) |
3 |
0% |
31.08.2010
09:28:01 |
| Mozilla/5.0-Firefox/3.0.15 (Firefox@mozilla.com) |
3 |
0% |
10.03.2010
04:54:04 |
| drone |
3 |
0% |
02.06.2010
12:35:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3)
Gecko/20100401 Firefox/3.6.3 |
3 |
0% |
22.05.2010
09:57:19 |
| Openstat/0.1 |
3 |
0% |
09.07.2010
15:09:30 |
| webmoney.advisor/Nutch-1.0 |
3 |
0% |
19.08.2010
11:59:17 |
| agbot/1.0 (AgHaven.com search engine crawler;
http://search.aghaven.com; bot@aghaven.com) |
3 |
0% |
23.07.2010
19:25:26 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322;
+http://www.archive.org) |
3 |
0% |
03.09.2010
03:00:46 |
| Nutch Crawler/Nutch-1.1 |
3 |
0% |
31.08.2010
13:29:49 |
| Googlebot/Test (+http://www.googlebot.com/bot.html) |
2 |
0% |
20.04.2004
04:25:00 |
| Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler) |
2 |
0% |
21.05.2004
16:36:34 |
| IlTrovatore-Setaccio/1.2-dev (Indexing;
http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
2 |
0% |
08.05.2004
11:59:57 |
| IlTrovatore-Setaccio/1.2 (Indexing;
http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
2 |
0% |
15.06.2004
18:12:14 |
| larbin_2.6.3_for_(http://cosco.hiit.fi/search/)
(Tomi.Silander@hiit.fi) |
2 |
0% |
11.07.2004
01:57:41 |
| mozDex/0.05-dev (mozDex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
2 |
0% |
02.07.2004
04:47:53 |
| Wget/1.9.1 |
2 |
0% |
24.05.2005
10:48:04 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705;
.NET CLR 1.1.4322; MSIECrawler) |
2 |
0% |
03.05.2005
15:03:53 |
| augurfind V-1.8 |
2 |
0% |
15.08.2004
22:08:33 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; IBP) |
2 |
0% |
20.09.2004
09:15:17 |
| Scooter/3.3Y!CrawlX |
2 |
0% |
03.09.2004
14:59:56 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FDM;
MSIECrawler) |
2 |
0% |
10.09.2004
17:18:41 |
| ZipppBot/0.11 (ZipppBot; http://www.zippp.net; webmaster@zippp.net) |
2 |
0% |
24.10.2004
23:36:39 |
| NextGenSearchBot 1 (for information visit
http://www.eliyon.com/NextGenSearchBot) |
2 |
0% |
06.05.2005
02:45:49 |
| Mozilla/4.0 (stat 0.11) (statbot@gmail.com) |
2 |
0% |
30.10.2004
23:36:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0) |
2 |
0% |
17.10.2004
11:48:21 |
| W3C-checklink/4.0 [4.4] libwww-perl/5.800 |
2 |
0% |
26.10.2004
14:36:33 |
| Mozilla/4.7 [en](Exabot@exava.com) |
2 |
0% |
21.11.2004
17:32:24 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) Opera 7.54 [de] |
2 |
0% |
26.11.2004
07:39:17 |
| MJ12bot/v0.5.0
(http://www.majestic12.co.uk/projects/dsearch/mj12bot.php) run by
PeerID=E71E149BF7B07EFCFE510E729DD2B9E3
MemberID=C9403BB515387FBB631AC512950E6F0E |
2 |
0% |
26.11.2004
19:07:36 |
| getRAX/getRAX Crawler 07.1 (+http://www.getRAX.com) |
2 |
0% |
30.11.2004
09:03:44 |
| Motoricerca-Robots.txt-Checker/1.0
(http://tool.motoricerca.info/robots-checker.phtml) |
2 |
0% |
30.11.2004
23:27:46 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.5);
MSIECrawler) |
2 |
0% |
03.12.2004
19:49:24 |
| gazz/5.0 (gazz@nttr.co.jp) |
2 |
0% |
24.12.2004
21:56:32 |
| Java/1.4.1_02 |
2 |
0% |
12.05.2005
08:58:00 |
| MJ12bot/v0.8.5
(http://www.majestic12.co.uk/projects/dsearch/mj12bot.php?V=v0.8.5&NID
=00B05BD11311C153&MID=7A764EA9585B2914&BID=C6B394EFB2CEBC23A5467AD31F8
1D2B9 |
2 |
0% |
27.01.2005
04:59:47 |
| Mozilla/1.0 |
2 |
0% |
31.03.2005
22:08:02 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.0.0)
Gecko/20020530 |
2 |
0% |
19.02.2005
17:48:44 |
| Mozilla/5.0 (compatible; BecomeBot/2.2.1; MSIE 6.0 compatible;
+http://www.become.com/webmasters.html) |
2 |
0% |
24.02.2005
03:25:31 |
| pipeLiner/0.10 (PipeLine Spider;
http://www.pipeline-search.com/webmaster.html) |
2 |
0% |
13.03.2005
06:11:26 |
| PhpDig/1.8.7 (+http://www.phpdig.net/robot.php) |
2 |
0% |
22.02.2005
23:42:50 |
| Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0 FAKE
(compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
2 |
0% |
03.03.2005
23:42:00 |
| thumbshots-de-Bot (Version: 1.02, powered by www.thumbshots.de) |
2 |
0% |
24.08.2006
19:23:30 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; de-DE; rv:1.7.5)
Gecko/20041108 Firefox/1.0 StumbleUpon/1.999 |
2 |
0% |
15.03.2005
22:15:45 |
| ObjectsSearch/0.07 (ObjectsSearch;
http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com) |
2 |
0% |
19.03.2005
02:16:22 |
| MJ12bot/v0.9.0 (http://majestic12.co.uk/bot.php?+) |
2 |
0% |
20.03.2005
19:55:51 |
| BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) |
2 |
0% |
19.06.2005
23:00:22 |
| Steeler/3.0 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
2 |
0% |
11.04.2005
21:24:14 |
| Mozilla/5.0 (compatible; BecomeBot/2.2.5; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
2 |
0% |
14.05.2005
01:12:42 |
| Mozilla/5.0 (wgao@genieknows.com) |
2 |
0% |
27.04.2005
05:37:30 |
| AIBOT/2.1 By +(www.21seek.com , A Real artificial intelligence search
engine , China) |
2 |
0% |
24.07.2005
19:34:36 |
| UnChaos, From Chaos To Order, Hybrid Web Search Engine at
http://www.unchaos.com (info@unchaos.com) |
2 |
0% |
07.06.2005
21:59:42 |
| NutchCVS/0.06-dev (WebCam search project-U of Washington ;
http://www.nutch.org/docs/en/bot.html; lfaris@cs.washington.edu) |
2 |
0% |
03.06.2005
04:31:44 |
| Mozilla/4.76 [en] (WinNT; U) |
2 |
0% |
08.06.2005
00:51:14 |
| EuripBot/0.2 (+http://www.eurip.com) GetRobots |
2 |
0% |
17.08.2005
11:25:14 |
| Mozilla/4.0 (SunOS 5.8) |
2 |
0% |
14.06.2005
17:23:27 |
| HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp) |
2 |
0% |
28.09.2006
03:40:34 |
| NCSA Beta 1 (http://vias.ncsa.uiuc.edu/viasarchivinginformation.html) |
2 |
0% |
21.06.2005
03:09:14 |
| findlinks/0.939 (+http://wortschatz.uni-leipzig.de/findlinks/) |
2 |
0% |
13.07.2005
21:17:12 |
| mozilla/5.0 (compatible; heritrix/1.2.0 +http://www.offis.de) |
2 |
0% |
13.07.2005
10:04:00 |
| WebIndexer/1-dev (WebIndexer; webindexerv1@yahoo.com;
webindexerv1@yahoo.com) |
2 |
0% |
14.07.2005
15:55:27 |
| OmniExplorer_Bot/2.57 (+http://www.omni-explorer.com) WorldIndexer |
2 |
0% |
15.07.2005
18:48:41 |
| OmniExplorer_Bot/2.82 (+http://www.omni-explorer.com) WorldIndexer |
2 |
0% |
20.07.2005
22:28:46 |
| UofTDB_experiment (leehyun@cs.toronto.edu) |
2 |
0% |
23.07.2005
01:56:05 |
| ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl) |
2 |
0% |
01.08.2005
02:35:46 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; Media Center PC 3.1; MSIECrawler) |
2 |
0% |
10.01.2007
19:15:06 |
| boitho.com-dc/0.82 ( http://www.boitho.com/dcbot.html ) |
2 |
0% |
06.08.2008
17:02:46 |
| findlinks/0.956 (+http://wortschatz.uni-leipzig.de/findlinks/) |
2 |
0% |
30.08.2005
05:01:44 |
| 8·¦p¨Âms |
2 |
0% |
16.08.2005
13:45:42 |
| t |
2 |
0% |
16.08.2005
21:10:04 |
| èçGp8÷5t |
2 |
0% |
17.08.2005
15:10:31 |
| Mozilla/4.0 (Windows NT 4.0) |
2 |
0% |
23.08.2005
18:16:14 |
| Virgo/0.7 (-; http://virgo.tiedonhaku.fi/; n/a) |
2 |
0% |
30.08.2005
07:13:18 |
| IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html) |
2 |
0% |
06.09.2005
09:51:18 |
| eagle
Accept: */*
Referer: http://www.licats.com/ |
2 |
0% |
07.09.2005
15:26:27 |
| findlinks/0.968 (+http://wortschatz.uni-leipzig.de/findlinks/) |
2 |
0% |
15.09.2005
14:41:22 |
| SBIder/0.7 (SBIder; http://www.sitesell.com/sbider.html;
http://support.sitesell.com/contact-support.html) |
2 |
0% |
21.09.2005
09:04:26 |
| NutchOSU-VLIB/0.7 (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
2 |
0% |
07.10.2005
21:57:46 |
| findlinks/0.973 (+http://wortschatz.uni-leipzig.de/findlinks/) |
2 |
0% |
20.09.2005
20:05:29 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
FunWebProducts; MSIECrawler) |
2 |
0% |
21.08.2009
17:41:11 |
| Teoma |
2 |
0% |
04.11.2005
05:27:25 |
| FAST Enterprise Crawler 6 used by Sensis.com.au Web Crawler
(search_commentsatsensisdotcomdotau) |
2 |
0% |
30.09.2005
16:21:57 |
| InternetArchive/0.8-dev (Nutch;
http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
2 |
0% |
28.09.2005
06:20:38 |
| Wget/1.10.1 |
2 |
0% |
13.03.2006
10:18:12 |
| CsCrawler RPT-HTTPClient/0.3-3 |
2 |
0% |
20.10.2005
21:45:20 |
| Deepindex |
2 |
0% |
21.10.2005
04:26:46 |
| IRLbot/2.0 (+http://irl.cs.tamu.edu/crawler) |
2 |
0% |
26.01.2006
04:34:01 |
| augurfind V-2 beta1 |
2 |
0% |
16.04.2006
17:41:24 |
| findlinks/1.01 (+http://wortschatz.uni-leipzig.de/findlinks/) |
2 |
0% |
28.10.2005
02:40:05 |
| MJ12bot/v1.0.4 (http://majestic12.co.uk/bot.php?+) |
2 |
0% |
25.11.2005
10:40:27 |
| OutfoxBot/0.3 (For internet experiments; http://;
outfox.agent@gmail.com) |
2 |
0% |
12.11.2005
22:34:33 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322;
HbTools 4.7.2; MSIECrawler) |
2 |
0% |
18.11.2005
20:03:44 |
| e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) |
2 |
0% |
29.12.2005
18:30:31 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; PeoplePal 6.2;
MSIECrawler) |
2 |
0% |
22.11.2005
03:46:18 |
| ejupiter.com |
2 |
0% |
26.11.2005
11:06:44 |
| Mozilla/5.0 (compatible; Kyluka krawl;
http://www.kyluka.com/krawl.html) |
2 |
0% |
04.12.2005
02:57:50 |
| SynooBot/0.7.1 (SynooBot; http://www.synoo.de/bot.html;
webmaster@synoo.com) |
2 |
0% |
13.12.2005
22:27:56 |
| Mozilla/5.0 (compatible; OnetSzukaj/5.0; +http://szukaj.onet.pl |
2 |
0% |
08.01.2006
07:46:55 |
| VORTEX/1.2 (+http://marty.anstey.ca/robots/vortex/) |
2 |
0% |
27.12.2005
18:42:22 |
| MapoftheInternet.com (+http://MapoftheInternet.com) |
2 |
0% |
26.01.2006
12:05:35 |
| ccubee/4.0 |
2 |
0% |
01.02.2006
09:46:15 |
| yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.4; java 1.4.2_09;
Europe/de) |
2 |
0% |
09.02.2006
00:39:40 |
| Forschungsportal/0.8-dev (Testinstallation;
http://www.forschungsportal.net/; nutch-agent@lucene.apache.org) |
2 |
0% |
05.02.2006
13:57:35 |
| FAST Enterprise Crawler 6 / Scirus scirus-crawler@fast.no;
http://www.scirus.com/srsapp/contactus/ |
2 |
0% |
04.02.2006
14:59:23 |
| PhpDig/1.8.9 RC1 (+http://www.phpdig.net/robot.php) |
2 |
0% |
14.02.2006
06:35:38 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12)
Gecko/20050915 Firefox/1.0.7 |
2 |
0% |
02.03.2006
02:12:44 |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.15 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
2 |
0% |
05.03.2006
03:16:38 |
| NuSearch Spider (compatible; MSIE 6.0) |
2 |
0% |
04.03.2006
09:59:50 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
2 |
0% |
11.03.2006
22:19:29 |
| CSCrawler ->
http://www.kde.cs.uni-kassel.de/lehre/ss2005/googlespam/crawler.html
RPT-HTTPClient/0.3-3 |
2 |
0% |
28.03.2006
01:46:33 |
| LinkChecker/3.4 (+http://linkchecker.sourceforge.net/) |
2 |
0% |
25.04.2006
15:19:01 |
| OmniExplorer_Bot/6.47 (+http://www.omni-explorer.com) WorldIndexer |
2 |
0% |
18.03.2006
11:27:50 |
| Mozilla/5.0 (compatible; vermut +http://vermut.aol.com) |
2 |
0% |
31.05.2006
12:53:09 |
| Mozilla/5.0 (Windows;) NimbleCrawler 2.0.0 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
2 |
0% |
15.04.2006
03:15:27 |
| larbin_2.6.3 (capveg@cs.umd.edu) |
2 |
0% |
06.05.2006
06:04:53 |
| Privoxy/3.0 (Anonymous) |
2 |
0% |
18.04.2006
17:59:42 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
2 |
0% |
29.04.2006
19:09:31 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
2 |
0% |
22.05.2006
19:52:48 |
| PeerFactor Crawler |
2 |
0% |
10.05.2006
15:37:05 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
2 |
0% |
26.05.2006
14:13:26 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; de; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
2 |
0% |
24.05.2006
14:23:13 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
2 |
0% |
01.06.2006
06:11:41 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; de; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
2 |
0% |
09.06.2006
15:51:12 |
| Swooglebot/2.0. (+http://swoogle.umbc.edu/swooglebot.html) |
2 |
0% |
10.04.2007
04:13:05 |
| Blaiz-Bee/2.00.5502 (+http://www.blaiz.net) |
2 |
0% |
24.07.2006
22:17:21 |
| Gigabot |
2 |
0% |
10.02.2007
05:13:16 |
| FAST Enterprise Crawler 6 used by WWU (wardi@uni-muenster.de) |
2 |
0% |
29.06.2006
08:52:42 |
| exactseek.com |
2 |
0% |
30.06.2006
15:55:29 |
| FeedChecker/0.01 |
2 |
0% |
24.05.2010
11:51:15 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; 1&1 Internet AG by
USt; .NET CLR 1.0.3705; MSIECrawler) |
2 |
0% |
14.07.2006
14:58:02 |
| MetagerBot/0.8-dev (MetagerBot; http://metager.de; ) |
2 |
0% |
22.07.2006
22:36:49 |
| Mozilla/5.0 (X11; U; Linux i686; de-AT; rv:1.8) Gecko/20051224
Debian/1.5.dfsg-3 Firefox/1.5 |
2 |
0% |
21.08.2006
11:41:13 |
| IlseBot/1.0 |
2 |
0% |
05.10.2006
05:10:14 |
| Mozilla/4.0 (compatible; NaverBot/1.0; nhnbot@naver.com) |
2 |
0% |
06.09.2006
22:54:20 |
| kakle-spider/0.1 (kakle-spider; http://www.kakle.com/bot.html;
support@kakle.com) |
2 |
0% |
10.09.2006
23:36:41 |
| YooW!/2.0.0 (+http://www.yoow.eu) |
2 |
0% |
14.09.2006
05:25:18 |
| libwww-perl/5.800 |
2 |
0% |
26.05.2007
18:20:46 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_08;
Europe/de) |
2 |
0% |
21.09.2006
03:20:04 |
| Mozilla/4.0 (compatible; Vagabondo/4.0Beta; webcrawler at wise-guys
dot nl; http://webagent.wise-guys.nl/) |
2 |
0% |
21.02.2009
15:21:27 |
| Mozilla/5.0 (Linux; en-US; Netscape 7) |
2 |
0% |
15.10.2006
16:47:09 |
| Mozilla/4.0 (compatible; MSIE is not me; DAUMOA/1.0.0; DAUM Web Robot;
Daum Communications Corp., Korea) |
2 |
0% |
25.12.2006
01:22:05 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.1) Gecko/20060601
Firefox/2.0 (Ubuntu-edgy) |
2 |
0% |
23.12.2006
15:24:57 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.6.0;
Europe/de) |
2 |
0% |
17.01.2007
15:18:50 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_10;
Europe/de) |
2 |
0% |
26.01.2007
12:45:56 |
| eApolloBot/1.0 (eApollo search engine robot; http://www.eapollo.com;
eapollo at global-opto dot com) |
2 |
0% |
29.01.2007
11:20:16 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.18; java 1.5.0_09;
Europe/de) |
2 |
0% |
14.02.2007
15:47:05 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.16-2-amd64-k8-smp; java
1.5.0_08; Europe/en) |
2 |
0% |
01.04.2007
22:25:35 |
| Mozilla/5.0 (compatible; MojeekBot/2.0;
http://www.mojeek.com/bot.html) |
2 |
0% |
09.12.2008
20:53:02 |
| Mozilla 4.3 |
2 |
0% |
01.03.2007
00:51:45 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; MSIECrawler) |
2 |
0% |
18.03.2007
14:43:05 |
| (null) |
2 |
0% |
21.03.2007
11:05:26 |
| Webscope/Nutch-0.9-dev
(http://www.cs.washington.edu/homes/mjc/agent.html) |
2 |
0% |
24.03.2007
09:59:12 |
| crawler/10.36 |
2 |
0% |
13.04.2007
18:13:22 |
| sogou web spider(+http://www.sogou.com/docs/help/webmasters.htm#07) |
2 |
0% |
02.04.2007
19:28:53 |
| SynooBot/SynooBot (compatible; Synoobot/0.9;
http://www.synoo.com/search/bot.html) |
2 |
0% |
02.04.2007
09:38:31 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Media Center PC 4.0;
MSIECrawler) |
2 |
0% |
01.04.2007
18:26:25 |
| NutchSIS/Nutch-0.8.1 |
2 |
0% |
08.04.2007
10:46:54 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.18-4-686; java 1.5.0_10;
GMT+01:00/de) |
2 |
0% |
29.11.2007
00:35:29 |
| Java/1.6.0 |
2 |
0% |
27.04.2007
02:18:58 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; eBook; MSIECrawler) |
2 |
0% |
02.05.2007
15:00:45 |
| Steeler/3.3 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
2 |
0% |
05.11.2007
18:17:21 |
| Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and
follows it) |
2 |
0% |
09.07.2007
15:35:56 |
| yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.9; java 1.5.0_07;
Europe/de) |
2 |
0% |
14.05.2007
21:52:52 |
| Mozilla/4.0 (Windows XP 5.1) Java/1.5.0_09 |
2 |
0% |
22.05.2007
18:43:48 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.6.0_01;
Europe/de) |
2 |
0% |
29.06.2007
02:06:34 |
| Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt
and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo
dot com) |
2 |
0% |
01.07.2007
04:44:56 |
| Gallent Search Spider v1.4 Robot 3 (http://robot.GallentSearch.com) |
2 |
0% |
15.06.2007
03:12:28 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.20.1; java 1.4.2_13;
Europe/en) |
2 |
0% |
16.07.2007
20:59:21 |
| yacy (www.yacy.net; v20040602; x86 Windows 2003 5.2; java 1.6.0_01;
Europe/de) |
2 |
0% |
03.07.2007
13:04:40 |
| Mozilla/5.0 (compatible; archive.org_bot/1.13.1x
+http://crawler.archive.org) |
2 |
0% |
26.07.2007
08:32:42 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
FunWebProducts; SIMBAR={C21297C2-7B18-40ad-A7BE-FB0C6FD61D1F}; .NET
CLR 2.0.50727; .NET CLR 1.1.4322; MSIECrawler) |
2 |
0% |
06.09.2007
10:38:41 |
| Wget/1.10.2 (Red Hat modified) |
2 |
0% |
17.11.2009
07:46:58 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6)
Gecko/20070725 Firefox/2.0.0.6 |
2 |
0% |
01.10.2007
00:13:33 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.6)
Gecko/20070725 Firefox/2.0.0.6 |
2 |
0% |
18.09.2007
06:22:35 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1.4)
Gecko/20070515 Firefox/2.0.0.4 (larbin@unspecified.mail) |
2 |
0% |
20.09.2007
12:27:54 |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com)
[email:paul@page-store.com] |
2 |
0% |
04.02.2008
06:31:41 |
| bubblenutch/Nutch-0.9 (www.bubblecast.ru bot; www.bubblecast.ru;
bubble@bubblecast.ru) |
2 |
0% |
26.10.2007
04:57:49 |
| Pete-Spider Light/1.0 |
2 |
0% |
03.10.2007
14:58:58 |
| NetinfoBot/1.0/Nutch-0.9 (http://netinfo.bg/netinfobot.html) |
2 |
0% |
11.10.2007
11:08:48 |
| testBOT/0.001 |
2 |
0% |
14.10.2007
23:06:38 |
| yacy (www.yacy.net; v20040602; x86 Windows 2003 5.2; java 1.6.0_03;
Europe/de) |
2 |
0% |
01.01.2008
17:04:04 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.9)
Gecko/20071025 Firefox/2.0.0.9 |
2 |
0% |
17.11.2007
18:45:45 |
| Teemer (NetSeer, Inc. is a Los Angeles based Internet startup
company.; http://www.netseer.com/crawler.html; crawler@netseer.com) |
2 |
0% |
15.11.2007
03:13:24 |
| sait/Nutch-0.9 (SAIT Research; http://www.samsung.com) |
2 |
0% |
09.11.2007
18:08:40 |
| nutch/Nutch-1.0-dev (nutch.biz; crawler@nutch.biz) |
2 |
0% |
13.11.2007
05:42:25 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.22-14-rt; java 1.6.0_03;
Europe/de) |
2 |
0% |
21.03.2008
12:53:01 |
| Mozilla/5.0 (compatible; NavissoBot/1.8;
+http://navisso.com/topics?c=navissobot) |
2 |
0% |
20.11.2007
07:00:12 |
| travel-search |
2 |
0% |
04.02.2008
13:14:23 |
| nutch/Nutch-0.9 (nutch) |
2 |
0% |
22.11.2007
17:21:07 |
| WebReaper v9.8 - www.webreaper.net |
2 |
0% |
13.11.2009
23:15:38 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11)
Gecko/20071127 Firefox/2.0.0.11 |
2 |
0% |
28.12.2007
16:21:32 |
| GeonaBot/1.2; http://www.geona.com/ |
2 |
0% |
13.03.2008
16:31:30 |
| NUTCHCRAWLER/Nutch-0.9 (anouar@yatinoo.com) |
2 |
0% |
13.01.2008
00:28:53 |
| Runnk RSS aggregator : http://www.runnk.com/ (hybridwse@runnk.com) |
2 |
0% |
13.02.2008
23:11:00 |
| VadixBot_Exp |
2 |
0% |
24.02.2008
17:47:13 |
| Mahiti.Com/Mahiti Crawler-1.0 (Mahiti.Com; http://mahiti.com ;
mahiti.com) |
2 |
0% |
01.03.2008
06:02:43 |
| Pete-Spider Light/1.46 |
2 |
0% |
05.03.2008
11:32:39 |
| yoofind/yoofind-0.1-dev (yoono webcrawler; http://www.yoono.com ;
MyEmail) |
2 |
0% |
12.03.2008
10:51:23 |
| W3C-checklink/4.3 [4.42] libwww-perl/5.805 |
2 |
0% |
19.08.2008
15:45:52 |
| ShablastBot 1.0 |
2 |
0% |
25.03.2008
20:01:45 |
| Mozilla/5.0 (compatible; Nutch/0.9;
+http://lucene.apache.org/)/Nutch-0.9 (Nutch 0.9 experimental;
http://www.mind-to-mind.com; gtn@mind-to-mind.com) |
2 |
0% |
31.03.2008
01:05:30 |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.pubsub.com) |
2 |
0% |
01.04.2008
04:14:58 |
| TRAVEL.com - travel-search engine (see
http://www.travel.com/spiders.html) |
2 |
0% |
08.04.2008
13:30:49 |
| REAP-crawler Nutch/Nutch-1.0-dev (Reap Project;
http://reap.cs.cmu.edu/REAP-crawler/; Reap Project) |
2 |
0% |
05.12.2008
12:30:20 |
| Rankivabot/3.2 (www.rankiva.com; 3.2; vzmxikn) |
2 |
0% |
04.04.2009
14:24:28 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; EmbeddedWB
14,52 from: http://www.bsalsa.com/ EmbeddedWB 14,52; .NET CLR
1.1.4322; InfoPath.2; .NET CLR 2.0.50727; MSIECrawler) |
2 |
0% |
12.04.2008
01:45:56 |
| CentiverseBot |
2 |
0% |
03.05.2008
20:11:07 |
| Acoon-Robot 4.0.1 (http://www.acoon.de) |
2 |
0% |
02.05.2008
01:25:34 |
| ZipppBot/0.0.1 (ZipppBot; http://www.qnect.net/; qbot@qnect.net) |
2 |
0% |
06.05.2008
18:43:24 |
| Java/1.6.0_06 |
2 |
0% |
06.05.2008
03:20:16 |
| Mozilla/5.0 (compatible; janforman.com/2.3; +http://enter4u.eu/) |
2 |
0% |
13.07.2008
06:21:36 |
| ./..9 (...; http://www...com; .@..com) |
2 |
0% |
27.05.2008
09:10:29 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9) Gecko/2008052912
Firefox/3.0 |
2 |
0% |
01.07.2008
17:34:10 |
| SqwidgeBot a0.3.21 - (http://www.sqwidge.com/bot/) |
2 |
0% |
06.07.2008
06:07:54 |
| flatlandbot/flatlandbot (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot;
jason@flatlandindustries.com) |
2 |
0% |
24.08.2008
13:25:08 |
| DataparkSearch/4.50 (+http://dataparksearch.org/bot) |
2 |
0% |
29.07.2008
16:59:55 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.1)
Gecko/2008070208 Firefox/3.0.1 |
2 |
0% |
22.09.2008
17:56:41 |
| Biglotron/Nutch-1.0 (V 3.01; gesnault@geniproj.com) |
2 |
0% |
25.08.2008
22:31:06 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.16)
Gecko/20080702 Firefox/2.0.0.16 |
2 |
0% |
15.03.2009
12:35:33 |
| Mozilla/5.0 (Twiceler +http://www.cuil.com/twiceler/robot.html) |
2 |
0% |
30.08.2008
06:11:52 |
| nutch-solr/Nutch-1.0-dev |
2 |
0% |
01.11.2008
11:01:55 |
| larbin (larbin@unspecified.mail) |
2 |
0% |
12.09.2008
23:38:52 |
| Mozilla/4.0 (compatible; Arachmo) |
2 |
0% |
21.03.2010
15:36:15 |
| KnowItAll/Nutch-0.9 (Nutch-UW-Crawler;
http://cs.washington.edu/homes/mjc/crawler.html;
uwcrawler08@gmail.com) |
2 |
0% |
16.09.2008
18:35:00 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.16)
Gecko/20080702 Firefox/2.0.0.16 |
2 |
0% |
18.09.2008
15:07:14 |
| lmspider/Nutch-0.9-dev (For research purposes.; www.nuance.com;
lmspider@nuance.com) |
2 |
0% |
22.09.2008
14:32:34 |
| beast/Nutch-1.0-dev (agentpider; agent.email.com; beast@gmail.com) |
2 |
0% |
06.10.2008
22:54:19 |
| yacybot (i386 Linux 2.6.18-6-686; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
2 |
0% |
24.11.2008
17:04:14 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
2 |
0% |
09.11.2008
22:42:27 |
| LinguaBot/v0.001-dev (MultiLinual Sarch Engine v0.001; LinguSeek; adin
at linguaseek dot com) |
2 |
0% |
12.10.2008
06:55:13 |
| BoeserSeoSpider |
2 |
0% |
06.11.2008
16:06:49 |
| Neo Lee/Nutch-0.9 (Nutch spiderman; http://lucene.apache.org/nutch/;
MyEmail) |
2 |
0% |
25.11.2008
05:31:03 |
| iCcrawler - iCjobs Stellenangebote Jobs (http://www.icjobs.de) |
2 |
0% |
09.11.2008
16:35:35 |
| txmob/0.1 (-; http://txmob.com ; crawl@txmob.com) |
2 |
0% |
03.11.2008
06:09:07 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.3)
Gecko/2008092417 Firefox/3.0.3 |
2 |
0% |
02.11.2008
15:09:47 |
| Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com) |
2 |
0% |
11.11.2008
12:00:42 |
| YamanaLab@Waseda robots.txt Crawler |
2 |
0% |
12.11.2008
14:00:32 |
| Toot/Nutch-0.9 (Toot crawler; http://www.toot.ch/; crawler@toot.ch) |
2 |
0% |
16.11.2008
17:28:18 |
| Mozilla/5.0 (compatible; testel-es-bot/0.1;
+http://www.testeles.com/index.jsp) |
2 |
0% |
20.12.2008
04:42:49 |
| IOI/2.0 (ISC Open Index crawler; http://index.isc.org/;
bot@index.isc.org) |
2 |
0% |
11.12.2008
01:22:01 |
| CazoodleBot/0.0.2 (http://www.cazoodle.com/contact.php;
cbot@cazoodle.com) |
2 |
0% |
03.01.2009
13:36:12 |
| Mozilla/5.0 (X11; U; Linux i686; en-CA; rv:1.8.0.2) Gecko/20060413
Firefox/1.5.0.2 |
2 |
0% |
30.12.2008
15:45:30 |
| LLWC |
2 |
0% |
31.12.2008
22:25:54 |
| inutch/Nutch-0.9 (inutch description; inutch.info; inuthc@inutch.info) |
2 |
0% |
07.01.2009
04:06:40 |
| Grub/2.0 (IOI crawler; http://index.isc.org/; crawl@index.isc.org) |
2 |
0% |
24.02.2009
06:09:23 |
| ip2 (larbin2.6.3@unspecified.mail) |
2 |
0% |
29.01.2009
15:38:00 |
| ecoNet (Spider; http://www.eco.afholderbach.net; eco at afholderbach
dot net) |
2 |
0% |
21.01.2009
20:14:46 |
| larbin_2.6.3 (jinyuny@cs.rutgers.edu) |
2 |
0% |
27.01.2009
06:47:23 |
| Shelob (shelob@gmx.net) |
2 |
0% |
12.03.2009
04:24:10 |
| googlebot (search@socbay.com) |
2 |
0% |
01.10.2009
10:00:08 |
| yacybot (amd64 FreeBSD 7.1-STABLE; java 1.6.0_07; Europe/en)
http://yacy.net/bot.html |
2 |
0% |
19.02.2009
00:16:30 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.6)
Gecko/2009011913 Firefox/3.0.6 |
2 |
0% |
26.02.2009
17:43:19 |
| Wget/1.10.2+(+Red+Hat+modified) |
2 |
0% |
27.02.2009
09:54:31 |
| yacybot (amd64 Linux 2.6.18-92.1.18.el5.028stab060.2; java 1.6.0_07;
Universal/en) http://yacy.net/bot.html |
2 |
0% |
03.03.2009
02:36:31 |
| yacybot (i386 Linux 2.6.24-24-generic; java 1.6.0_07; Europe/en)
http://yacy.net/bot.html |
2 |
0% |
20.05.2009
21:03:22 |
| Genrepsoft/Nutch-0.9 (Test Nutch Crawler; genrepsoft.net; vlatko at
genrepsoft dot info) |
2 |
0% |
31.03.2009
23:34:58 |
| smatrix_bot/Nutch-1.0 (SMatrix Crawler; http://85.10.204.138) |
2 |
0% |
01.04.2009
10:03:50 |
| Isara-Search/Isara-1.0 (A non-profit web crawler operated by a charity
organization.; www.isara.org; webmaster@isara.org) |
2 |
0% |
10.04.2009
19:29:30 |
| OOZBOT/0.20 (--; http://www.setooz.com/oozbot.html; agentname at
setooz dot_com) |
2 |
0% |
14.04.2009
08:01:08 |
| renlifangbot/1.0 (+http://search.msn.com/msnbot.htm) |
2 |
0% |
23.05.2009
07:22:22 |
| Mozilla/5.0 (X11; U; NetBSD i386; en-US; rv:1.8.0.2) Gecko/20060415
Firefox/1.5.0.2 |
2 |
0% |
21.04.2009
05:30:08 |
| Mozilla/5.0 (X11; U; OpenBSD sparc64; pl-PL; rv:1.8.0.2)
Gecko/20060429 Firefox/1.5.0.2 |
2 |
0% |
21.04.2009
05:31:21 |
| RiceComputerArchitecture Crawler/Nutch-1.0 |
2 |
0% |
13.05.2009
00:25:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.0.10)
Gecko/2009042316 Firefox/3.0.10 |
2 |
0% |
08.05.2009
15:36:09 |
| AppEngine-Google; (+http://code.google.com/appengine) |
2 |
0% |
16.05.2009
01:31:07 |
| Mozilla/5.0 (compatible; lincobot/0.3;
http://www.linksco.com/about/robot.html) AppEngine-Google;
(+http://code.google.com/appengine) |
2 |
0% |
16.05.2009
01:31:07 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_13; Europe/de)
http://yacy.net/bot.html |
2 |
0% |
20.05.2009
19:59:59 |
| ru_prgnet_viewer (larbin2.6.3@unspecified.mail) |
2 |
0% |
26.05.2009
07:15:48 |
| Mozilla/4.0 (compatible;
http://search.thunderstone.com/texis/websearch/about.html) |
2 |
0% |
26.05.2010
04:56:33 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; Avant
Browser; GTB6; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR
3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.0.4506.2152; .NET CLR
3.5.30729) |
2 |
0% |
11.06.2009
19:29:36 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10)
Gecko/2009042316 Firefox/3.0.10 |
2 |
0% |
02.06.2009
15:21:18 |
| adidxbot/1.1 (+http://search.msn.com/msnbot.htm) |
2 |
0% |
13.06.2009
09:02:52 |
| MySearch/Nutch-1.0 (Nutch spiderman;
http://peterpuwang.googlepages.com; MyEmail) |
2 |
0% |
14.06.2009
04:20:38 |
| compatible; Mozilla 4.0; MSIE 5.5; (SqwidgeBot b1 -
http://www.sqwidge.com/bot/) |
2 |
0% |
14.06.2009
17:50:10 |
| Mike-Crawler |
2 |
0% |
21.06.2009
21:22:25 |
| Java/1.6.0_13 |
2 |
0% |
21.06.2009
21:22:25 |
| James Prabhu/Nutch-1.0 (Nutch spiderman; http://www.cosmoage.com ;
MyEmail) |
2 |
0% |
15.08.2009
09:34:15 |
| nutch.us/Nutch-1.0 (nutch.us; crawler@nutch.us) |
2 |
0% |
03.10.2009
01:26:45 |
| page_viewer (larbin2.6.3@unspecified.mail) |
2 |
0% |
18.07.2009
03:16:08 |
| Mozilla/5.0 (Windows; N; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727)/Nutch-1.0 (Crawler; lucene.apache.org/nutch/; a@b.net) |
2 |
0% |
19.07.2009
22:49:58 |
| Mozilla/5.0 (compatible; Estbot/1.0; http://www.estsoft.com/) |
2 |
0% |
21.07.2009
22:53:37 |
| nutch/Nutch-1.0 (nutch) |
2 |
0% |
23.08.2009
09:57:41 |
| Mozilla/4.0 http://referencement.abaabaa.com/add_url_GRATUIT.php :
Easy referencement (version 1.0) |
2 |
0% |
12.08.2009
10:18:09 |
| cn_ab_viewer (larbin2.6.3@unspecified.mail) |
2 |
0% |
06.08.2009
05:19:06 |
| OMGCrawler 1.0 |
2 |
0% |
15.08.2009
21:15:44 |
| smart.apnoti.com Robot/v1.34
(http://smart.apnoti.com/en/aboutApnotiWebCrawler.html) |
2 |
0% |
16.10.2009
19:50:48 |
| Mozilla/5.0 (compatible; Plukkie/1.1;
http://www.botje.com/plukkie.htm) |
2 |
0% |
28.08.2009
00:08:31 |
| http://ask.24x.info/ |
2 |
0% |
19.10.2009
12:17:03 |
| Mozilla/5.0 (compatible; Dolphin/1.0;
+http://telehouse.ru/crawler.html) |
2 |
0% |
19.10.2009
21:29:56 |
| Qseero v1.0.0 |
2 |
0% |
05.10.2009
10:43:43 |
| yacybot (amd64 Windows Vista 6.0; java 1.6.0_15; Europe/de)
http://yacy.net/bot.html |
2 |
0% |
25.01.2010
19:02:17 |
| temaseek.com/Nutch-1.0 (temaseek.com; crawler@temaseek.com) |
2 |
0% |
13.10.2009
04:35:31 |
| Python-urllib/2.6 |
2 |
0% |
04.11.2009
02:36:45 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.9.1.5)
Gecko/20091102 Firefox/3.5.5 (.NET CLR 3.5.30729) |
2 |
0% |
14.12.2009
18:42:02 |
| Mozilla/5.0 (compatible; heritrix/1.14.3 +http://web.archive.org) |
2 |
0% |
23.12.2009
15:42:04 |
| Linguee Bot (bot@linguee.com) |
2 |
0% |
02.12.2009
15:24:54 |
| Mozilla/5.0 (compatible; aiHitBot-DM/2.0.2 +http://www.aihit.com) |
2 |
0% |
03.12.2009
17:32:41 |
| SheenBot/SheenBot-1.0.1 (Sheen web crawler) |
2 |
0% |
30.11.2009
07:45:28 |
| yacybot (amd64 Linux 2.6.28-17-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
2 |
0% |
21.01.2010
09:08:52 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.9.1.7)
Gecko/20091221 Firefox/3.5.7 GTB6 (.NET CLR 3.5.30729) |
2 |
0% |
27.01.2010
20:34:36 |
| Mozilla/5.0 (compatible; aiHitBot/1.0; +http://www.aihit.com/) |
2 |
0% |
14.05.2010
13:50:01 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; de; rv:1.9.1.7)
Gecko/20091221 Firefox/3.5.7 |
2 |
0% |
27.01.2010
22:04:20 |
| Wget/1.12 (linux-gnu; YaCy 0.1; yacy.net) |
2 |
0% |
26.04.2010
09:13:36 |
| Mozilla/5.0 (compatible; janforman.com/2.4; +http://janforman.com/) |
2 |
0% |
12.08.2010
11:30:14 |
| https_page_test (larbin2.6.3@unspecified.mail) |
2 |
0% |
02.03.2010
07:14:59 |
| Ruby EventMachine |
2 |
0% |
18.03.2010
00:01:57 |
| TEST/hoqBot-1.0 (dummy; http://www.dummy.com; info at dummy dot com) |
2 |
0% |
04.05.2010
19:05:03 |
| yacybot (amd64 Linux 2.6.31-19-server; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
2 |
0% |
07.04.2010
07:55:32 |
| AdultsVisitUs/Nutch-1.1 (www.AdultsVisitUs.com;
crawler@AdultsVisitUs.com) |
2 |
0% |
25.04.2010
08:36:50 |
| NetStudyBot1.0 |
2 |
0% |
01.05.2010
22:27:55 |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) |
2 |
0% |
23.05.2010
06:56:51 |
| research-scan-bot/Nutch-1.0 |
2 |
0% |
09.06.2010
16:59:51 |
| Mozilla/5.0 (compatible; Qualidator.com Bot 1.0;) |
2 |
0% |
29.05.2010
04:02:47 |
| Mozilla/5.0 (compatible; archive.org_bot/heritrix-1.15.4
+http://www.archive.org) |
2 |
0% |
15.06.2010
01:10:07 |
| TwengaBot-Discover (http://www.twenga.fr/bot-discover.html) |
2 |
0% |
24.08.2010
20:16:08 |
| netEstate NE Crawler |
2 |
0% |
26.06.2010
12:04:53 |
| Hot php Scripts |
2 |
0% |
29.06.2010
09:52:00 |
| Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru) |
2 |
0% |
03.07.2010
22:35:22 |
| DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;
+http://help.goo.ne.jp/help/article/1142/) |
2 |
0% |
27.07.2010
02:30:42 |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1; SV1) ; Media Center PC 5.0) |
2 |
0% |
13.08.2010
02:06:29 |
| StatoolsBot (+http://www.statools.com/bot.html) |
2 |
0% |
10.08.2010
11:57:37 |
| hoge (co2h2onacl@gmail.com) |
2 |
0% |
21.08.2010
09:49:28 |
| AdultShop.Sg/Nutch-1.1 (www.AdultShop.Sg; crawler@AdultShop.Sg) |
2 |
0% |
31.08.2010
01:21:11 |
| Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/) |
2 |
0% |
27.08.2010
14:03:27 |
| Abortion.sg/Nutch-1.1 (www.Abortion.sg; crawler@Abortion.sg) |
2 |
0% |
02.09.2010
03:24:40 |
| Scooter/3.3.vscooter |
1 |
0% |
10.03.2004
13:34:27 |
| IlTrovatore-Setaccio/1.2 (+http://www.iltrovatore.it/aiuto/faq.html) |
1 |
0% |
11.03.2004
11:01:24 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; freenet DSL 1.1;
.NET CLR 1.0.3705; MSIECrawler) |
1 |
0% |
15.03.2004
14:10:18 |
| Mackster(http://www.click4choice.com ) |
1 |
0% |
02.04.2004
09:38:58 |
| augurnfind V-1.8 |
1 |
0% |
05.04.2004
23:21:26 |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0; (R1 1.3)) |
1 |
0% |
06.04.2004
23:30:40 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) |
1 |
0% |
08.04.2004
18:55:36 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; Alexa
Toolbar; .NET CLR 1.1.4322) |
1 |
0% |
09.04.2004
10:41:59 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; yie6_SBC; YPC 3.0.0;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
12.04.2004
22:02:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.6) Gecko/20040206
Firefox/0.8 |
1 |
0% |
13.04.2004
04:21:59 |
| CrawlConvera0.1 (CrawlConvera@yahoo.com) |
1 |
0% |
13.04.2004
07:33:59 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90; DT;
MSIECrawler) |
1 |
0% |
15.04.2004
18:58:36 |
| Iltrovatore-Setaccio |
1 |
0% |
17.04.2004
12:48:15 |
| htdig/3.1.6 (unconfigured@htdig.searchengine.maintainer) |
1 |
0% |
21.04.2004
16:21:03 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (root@ardaba.ch) |
1 |
0% |
27.04.2004
15:59:42 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.4.2.0;
MSIECrawler) |
1 |
0% |
02.05.2004
12:58:20 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) |
1 |
0% |
03.05.2004
16:28:01 |
| ZIPPPCVS/0.24 (ZipppBot/.24; http://www.zippp.net;
webmaster@zippp.net) |
1 |
0% |
06.05.2004
23:26:53 |
| semanticdiscovery/0.2(http://www.semanticdiscovery.com/sd/robot.html |
1 |
0% |
11.05.2004
17:02:27 |
| lwp-trivial/1.38 |
1 |
0% |
13.05.2004
16:20:28 |
| deepak-USC/ISI |
1 |
0% |
16.05.2004
15:35:22 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; YPC 3.0.0;
MSIECrawler) |
1 |
0% |
27.05.2004
12:11:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Avant Browser
[avantbrowser.com]) |
1 |
0% |
29.05.2004
16:14:37 |
| Openbot/3.0+(robot@monkia.com.tw;+http://gais.cs.ccu.edu.tw/robot.php) |
1 |
0% |
02.06.2004
22:13:08 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.4.6.0;
MSIECrawler) |
1 |
0% |
03.06.2004
15:15:06 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; DT; MSIECrawler) |
1 |
0% |
04.06.2004
22:10:37 |
| IlTrovatore-Setaccio/0.03-dev (Indexing;
http://www.iltrovatore.it/bot.html; info@iltrovatore.it) |
1 |
0% |
09.06.2004
06:47:45 |
| Mozilla/5.0 (X11; U; Linux i686; de-DE; rv:1.6) Gecko/20040207
Firefox/0.8 |
1 |
0% |
11.06.2004
20:34:25 |
| Googlebot |
1 |
0% |
12.06.2004
15:23:02 |
| Googlebot/2.1 |
1 |
0% |
12.06.2004
15:32:14 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.4.6.0;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
18.06.2004
14:39:18 |
| Aport |
1 |
0% |
22.06.2004
05:10:05 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90;
MSIECrawler) |
1 |
0% |
25.06.2004
19:29:49 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;
FunWebProducts-MyWay; (R1 1.3); MSIECrawler) |
1 |
0% |
27.06.2004
15:20:25 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.5.0.0;
MSIECrawler) |
1 |
0% |
29.06.2004
19:06:21 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6) Gecko/20040206
Firefox/0.8 |
1 |
0% |
04.07.2004
18:10:21 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7) Gecko/20040626
Firefox/0.9.1 |
1 |
0% |
09.07.2004
19:20:46 |
| Mackster( http://www.ukwizz.com ) |
1 |
0% |
16.07.2004
11:33:46 |
| wwwster/1.2 (Beta) |
1 |
0% |
21.07.2004
11:30:50 |
| Mozilla (de) |
1 |
0% |
01.08.2004
20:56:09 |
| boitho.com-dc/0.55 ( http://www.boitho.com/dcbot.html ) |
1 |
0% |
05.08.2004
06:00:28 |
| larbin_extended (larbin@oktie.com) |
1 |
0% |
06.08.2004
03:26:05 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; DX-Browser 5.0.0.0;
MSIECrawler) |
1 |
0% |
10.08.2004
17:40:06 |
| Tutorial Crawler 1.4 |
1 |
0% |
22.08.2004
09:57:43 |
| Mozilla/4.0 (compatible; MSIE 5.01; Windows 98; freenet DSL 1.00;
MSIECrawler) |
1 |
0% |
22.08.2004
21:44:49 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; QXW0339d; .NET CLR
1.1.4322; MSIECrawler) |
1 |
0% |
24.08.2004
19:17:49 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Strato DSL; IBP;
.NET CLR 1.1.4322) |
1 |
0% |
25.08.2004
05:48:05 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; .NET CLR 1.0.3705) |
1 |
0% |
01.09.2004
16:43:52 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; DT; MSIECrawler) |
1 |
0% |
06.09.2004
09:59:38 |
| CosmixCrawler/0.1 |
1 |
0% |
16.09.2004
08:47:42 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; 1&1 Internet AG by
USt; SV1; IBP; .NET CLR 1.1.4322) |
1 |
0% |
16.09.2004
16:53:20 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Avant Browser
[avantbrowser.com]; SV1) |
1 |
0% |
17.09.2004
05:20:48 |
| booch_1.0.7 (tankvit@e-mail.ru) |
1 |
0% |
22.09.2004
07:24:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20041001
Firefox/0.10.1 |
1 |
0% |
02.10.2004
15:44:35 |
| stat (statcrawler@gmail.com) |
1 |
0% |
03.10.2004
12:02:01 |
| TutorGigBot/1.5 ( +http://www.tutorgig.info ) |
1 |
0% |
04.10.2004
03:04:53 |
| PhpDig/1.6.2 (PHP; MySql) |
1 |
0% |
09.10.2004
06:52:40 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7) Gecko/20040707
Firefox/0.8 |
1 |
0% |
17.10.2004
22:22:04 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; i-NavFourF;
IBP; .NET CLR 1.1.4322) |
1 |
0% |
21.10.2004
20:25:02 |
| ASPseek/1.2.11pre |
1 |
0% |
25.10.2004
10:02:21 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; IZBSOFT) |
1 |
0% |
27.10.2004
08:13:43 |
| http://www.sygol.com |
1 |
0% |
04.11.2004
02:46:08 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; IBP; .NET CLR
1.1.4322; Alexa Toolbar) |
1 |
0% |
04.11.2004
03:24:26 |
| Ocelli/1.1 (http://www.globalspec.com/Ocelli) |
1 |
0% |
05.11.2004
06:37:04 |
| Mozilla/4.0 (compatible; MSIE 5.00; Windows 98) |
1 |
0% |
08.11.2004
08:09:45 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322;
Alexa Toolbar) |
1 |
0% |
10.11.2004
22:27:34 |
| Space2000-Bot (Version: 1.02, powered by www.space2000.de) |
1 |
0% |
14.11.2004
17:17:37 |
| EARTHCOM.info/1.6 [www.earthcom.info] |
1 |
0% |
21.11.2004
11:40:53 |
| Mozilla/4.7 [en](BecomeBot@exava.com) |
1 |
0% |
27.11.2004
07:14:54 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20040913
Firefox/0.10.1 |
1 |
0% |
27.11.2004
13:19:09 |
| ES.NET_Crawler/2.0 (http://www.innerprise.net/) |
1 |
0% |
28.11.2004
04:09:06 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.3)
Gecko/20040910 |
1 |
0% |
30.11.2004
23:24:43 |
| versus 0.2 (+http://versus.integis.ch) |
1 |
0% |
03.12.2004
01:59:51 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5)
Gecko/20041107 Firefox/1.0 |
1 |
0% |
08.12.2004
15:41:46 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.3); .NET
CLR 1.1.4322; MSIECrawler) |
1 |
0% |
10.12.2004
10:04:48 |
| Emmap-client/Alpha |
1 |
0% |
20.12.2004
15:45:49 |
| Mozilla/5.0 (compatible; BecomeBot/2.0beta;
+http://www.become.com/webmasters.html) |
1 |
0% |
27.12.2004
08:16:06 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7) Gecko/20040614
Firefox/0.9 |
1 |
0% |
02.01.2005
00:27:16 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts;
SV1; .NET CLR 1.1.4322) |
1 |
0% |
04.01.2005
14:32:56 |
| http://www.pisoc.com (tarantula) |
1 |
0% |
05.01.2005
03:04:27 |
| NutchCVS/0.06-dev (bot; http://www.nebel.de/bot.html;
nutch-agent@nebel.de) |
1 |
0% |
08.01.2005
05:19:43 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; .NET CLR 1.0.3705; MSIECrawler) |
1 |
0% |
11.01.2005
08:52:09 |
| booch_1.0.7 (booch__@e-mail.ru) |
1 |
0% |
11.01.2005
09:58:19 |
| Mozilla/5.0 (Windows; U; Win98; de-AT; rv:1.8a5) Gecko/20041122 |
1 |
0% |
12.01.2005
17:41:40 |
| grub crawler(http://www.grub.org) |
1 |
0% |
20.01.2005
00:10:32 |
| GigabotSiteSearch/2.0 (sitesearch.gigablast.com) |
1 |
0% |
23.01.2005
01:38:02 |
| ConveraCrawler/0.5 (+http://www |
1 |
0% |
23.01.2005
04:59:46 |
| TurnitinBot/2.0 http://www.turnitin.com/robot/crawlerinfo.html |
1 |
0% |
23.01.2005
18:35:12 |
| InnerpriseBot/1.0 (http://www.innerprise.com/) |
1 |
0% |
26.01.2005
02:20:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.5)
Gecko/20041122 Firefox/1.0 |
1 |
0% |
29.01.2005
14:04:00 |
| Opera/7.54u1 (Windows NT 5.1; U) [en] |
1 |
0% |
11.02.2005
03:11:27 |
| Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.0rc3) Gecko/20020524 |
1 |
0% |
19.02.2005
17:59:15 |
| W3C-checklink/4.1 [4.14] libwww-perl/5.803 |
1 |
0% |
19.02.2005
23:45:12 |
| NetResearchServer/2.9(loopimprovements.com/robot.html) |
1 |
0% |
24.02.2005
10:10:33 |
| GoForIt.com |
1 |
0% |
25.02.2005
12:31:20 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; QXW03398; MSIECrawler) |
1 |
0% |
02.03.2005
12:06:37 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Crazy Browser 1.0.5) |
1 |
0% |
03.03.2005
14:01:54 |
| KazoomBot/0.06-dev (Kazoom; http://www.kazoom.ca/bot.html;
kazoombot@kazoom.ca) |
1 |
0% |
03.03.2005
18:50:17 |
| Sopheus Project/0.01 (Nutch; http://www.thenetplanet.com;
info@thenetplanet.com) |
1 |
0% |
04.03.2005
14:52:43 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts;
SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
04.03.2005
17:56:48 |
| SeznamBot/1.0 |
1 |
0% |
07.03.2005
23:14:07 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.5); .NET
CLR 1.0.3705; .NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
09.03.2005
16:13:19 |
| POE-Component-Client-HTTP/0.65 (perl; N; POE; en; rv:0.650000) |
1 |
0% |
14.03.2005
05:41:30 |
| LWP::Simple/5.79 |
1 |
0% |
15.03.2005
20:29:08 |
| HooWWWer/2.1.0 (+http://cosco.hiit.fi/search/hoowwwer/ |
mailto:crawler-infohiit.fi) |
1 |
0% |
16.03.2005
14:23:52 |
| Mozilla/6.0 (compatible; arameda.com Spider) |
1 |
0% |
17.03.2005
18:09:20 |
| larbin_2.6.3 (larbin-2.6.3@unspecified.mail) |
1 |
0% |
18.03.2005
15:23:20 |
| Mozilla/4.0 (MobilePhone SCP-5500/US/1.0) NetFront/3.0 MMP/2.0
(compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
1 |
0% |
24.03.2005
07:04:19 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de-DE; rv:1.7.6)
Gecko/20050321 Firefox/1.0.2 |
1 |
0% |
25.03.2005
17:34:56 |
| YahooSeeker/CafeKelsa-dev (compatible; Konqueror/3.2; FreeBSD
;cafekelsa-dev-webmaster@yahoo-inc.com ) (KHTML, like Gecko) |
1 |
0% |
30.03.2005
04:21:23 |
| SCrawlTest/CR1 (CWD; http://sproose.com; crawl@sproose.com) |
1 |
0% |
31.03.2005
02:11:46 |
| abot/0.1 (abot; http://www.abot.com; abot@abot.com) |
1 |
0% |
01.04.2005
06:06:02 |
| AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html) |
1 |
0% |
02.04.2005
09:43:10 |
| Opera/8.0 (Windows NT 5.1; U; de) |
1 |
0% |
03.04.2005
11:13:37 |
| htdig/3.1.6
(xxx@le.droit.bourgeois.est.la.vaseline.des.enculeurs.du.peuple) |
1 |
0% |
03.04.2005
14:52:50 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; tele.ring; .NET CLR
1.1.4322; MSIECrawler) |
1 |
0% |
07.04.2005
09:24:16 |
| http://www.almaden.ibm.com/cs/crawler [bc35] |
1 |
0% |
07.04.2005
16:48:06 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.7)
Gecko/20050404 Firefox/1.0.3 |
1 |
0% |
09.04.2005
15:46:41 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.6)
Gecko/20050226 Firefox/1.0.1 |
1 |
0% |
09.04.2005
18:05:01 |
| NetResearchServer/3.4(loopimprovements.com/robot.html) |
1 |
0% |
09.04.2005
18:48:56 |
| MultiText/0.1 |
1 |
0% |
12.04.2005
01:33:50 |
| webcrawl.net |
1 |
0% |
12.04.2005
09:32:39 |
| Knowledge.com/0.2 |
1 |
0% |
14.04.2005
14:58:13 |
| bscrawler_0.1_alfa (abcdef@demo.com) |
1 |
0% |
18.04.2005
16:10:50 |
| ( Robots.txt Validator
http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ) |
1 |
0% |
22.04.2005
06:29:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7) Gecko/20040803
Firefox/0.9.3 |
1 |
0% |
24.04.2005
13:26:57 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; de-DE; rv:1.7.5)
Gecko/20041108 Firefox/1.0 |
1 |
0% |
29.04.2005
18:18:13 |
| IlTrovatore-Setaccio/1.2 (It-bot;compatible;MSIE 6.0;Mozilla/4.0;
http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) |
1 |
0% |
30.04.2005
00:47:44 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.7)
Gecko/20050414 Firefox/1.0.3 |
1 |
0% |
02.05.2005
02:55:17 |
| Java/1.4.2_03 |
1 |
0% |
02.05.2005
15:24:58 |
| Mozilla/5.0 (compatible; BecomeBot/1.85; MSIE 6.0 compatible;
+http://www.become.com/site_owners.html) |
1 |
0% |
03.05.2005
11:44:27 |
| ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl) |
1 |
0% |
10.05.2005
15:36:35 |
| findimbot/1.8.3 (http://www.findim.net/findimbot.php) |
1 |
0% |
13.05.2005
15:08:42 |
| larbin (protee@gmail.com) |
1 |
0% |
14.05.2005
12:31:30 |
| larbin_2.6.3 (sneha@iitk.ac.in) |
1 |
0% |
17.05.2005
14:28:03 |
| Mozilla/5.0 (compatible; heritrix/1.4.0
+http://www.basistech.com/crawlinfo.html) |
1 |
0% |
27.05.2005
02:02:46 |
| Wget/1.9 |
1 |
0% |
27.05.2005
09:31:17 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; DT; SV1;
MSIECrawler) |
1 |
0% |
29.05.2005
20:23:26 |
| ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl) |
1 |
0% |
31.05.2005
01:48:52 |
| mozilla/5.0 (compatible; genevabot +http://www.healthdash.com) |
1 |
0% |
02.06.2005
18:36:38 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; de-de) AppleWebKit/412
(KHTML, like Gecko) Safari/412 |
1 |
0% |
03.06.2005
16:18:49 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
08.06.2005
20:14:01 |
| simpsons-fc.de (compatible; MSIE 6.0; Windows NT 5.1; SV1; i-NavFourF;
.NET CLR 1.0.3705; .NET CLR 1.1.4322) |
1 |
0% |
09.06.2005
21:07:21 |
| larbin_2.6.3 (wgao@cs.dal.ca) |
1 |
0% |
13.06.2005
09:30:48 |
| ObjectsSearch/0.06 (ObjectsSearch;
http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com) |
1 |
0% |
16.06.2005
20:55:48 |
| savvybot/0.2 |
1 |
0% |
23.06.2005
10:32:09 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; de-de) AppleWebKit/312.1
(KHTML, like Gecko) Safari/312 |
1 |
0% |
26.06.2005
13:51:26 |
| axadine/ (Axadine Crawler; http://www.axada.de/; ) |
1 |
0% |
28.06.2005
18:49:18 |
| Minuteman/0.3 |
1 |
0% |
01.07.2005
00:41:44 |
| Gaisbot/3.0+(tlh93@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot
.php) |
1 |
0% |
02.07.2005
02:38:57 |
| NutchTestBot/0.0 (Nutch Test; ; crawler.support@gmail.com) |
1 |
0% |
02.07.2005
05:46:27 |
| silk/2.4 |
1 |
0% |
06.07.2005
01:13:14 |
| Mozilla/5.0 (compatible; heritrix/1.5.0 +http://www.offis.de/) |
1 |
0% |
08.07.2005
05:30:51 |
| Mozilla/5.0 (compatible; heritrix/1.5.0 +http://www.offis.de) |
1 |
0% |
09.07.2005
03:37:10 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-DE; rv:1.7.8)
Gecko/20050511 Firefox/1.0.4 |
1 |
0% |
10.07.2005
14:10:11 |
| OmniExplorer_Bot/2.5a (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
11.07.2005
09:03:21 |
| Akwan Crawler 0.1 |
1 |
0% |
12.07.2005
06:55:44 |
| Ultraknowledge Spider |
1 |
0% |
12.07.2005
09:46:07 |
| OmniExplorer_Bot/2.9a (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
12.07.2005
09:47:29 |
| OmniExplorer_Bot/2.42b (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
13.07.2005
20:24:49 |
| OmniExplorer_Bot/2.44c (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
13.07.2005
23:36:18 |
| OmniExplorer_Bot/2.47 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
14.07.2005
22:44:34 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; IBP) |
1 |
0% |
15.07.2005
03:54:30 |
| OmniExplorer_Bot/2.65 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
16.07.2005
00:52:35 |
| OmniExplorer_Bot/2.67 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
16.07.2005
16:58:29 |
| Orbiter/T-2.0 (+http://www.dailyorbit.com/bot.htm) |
1 |
0% |
16.07.2005
21:21:45 |
| OmniExplorer_Bot/2.69 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
17.07.2005
04:12:47 |
| OmniExplorer_Bot/2.71 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
18.07.2005
06:23:42 |
| Filangy/1.01 (Filangy;
http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp;
filangy-agent@filangy.com) |
1 |
0% |
18.07.2005
22:01:16 |
| OmniExplorer_Bot/2.73 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
19.07.2005
00:26:32 |
| Mozilla/4.0 (compatible) |
1 |
0% |
19.07.2005
18:49:24 |
| findlinks/0.944 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
20.07.2005
17:51:50 |
| OmniExplorer_Bot/2.86b (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
22.07.2005
23:16:09 |
| OmniExplorer_Bot/2.92 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
24.07.2005
00:29:45 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;) |
1 |
0% |
24.07.2005
10:22:06 |
| Mozilla/5.0 (X11; U; Linux i686;en-US; rv:1.2.1) Gecko/20030225 |
1 |
0% |
27.07.2005
21:49:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; .NET CLR 1.1.4322; Tablet PC 1.7; MSIECrawler) |
1 |
0% |
30.07.2005
16:41:31 |
| Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html) |
1 |
0% |
01.08.2005
20:48:30 |
| findlinks/0.945 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
02.08.2005
19:27:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Jacksonville
Job Corps Center; MSIECrawler) |
1 |
0% |
07.08.2005
00:40:47 |
| FAST Enterprise Crawler 6 used by Fast Search
(terje.marthinussen@fastsearch.com) |
1 |
0% |
09.08.2005
11:54:23 |
| searchbot (admin@google.com) |
1 |
0% |
10.08.2005
23:52:51 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; QXW03416;
MSIECrawler) |
1 |
0% |
13.08.2005
11:55:06 |
| DataparkSearch/4.32 (+http://www.dataparksearch.org/) |
1 |
0% |
15.08.2005
11:25:33 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; H010818; S.N.O.W.2;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
16.08.2005
08:45:44 |
| 8 |
1 |
0% |
16.08.2005
19:32:18 |
| èG~¨Š9€ |
1 |
0% |
16.08.2005
21:10:03 |
| Põ:zx79z |
1 |
0% |
17.08.2005
18:41:09 |
| /necacheH |
1 |
0% |
17.08.2005
21:05:42 |
| T_0턈 |
1 |
0% |
18.08.2005
21:44:06 |
| 0×õ—xGl |
1 |
0% |
18.08.2005
23:50:25 |
| Helix/1.2 (+http://www.sitesearch.ca/helix/) |
1 |
0% |
19.08.2005
02:16:10 |
| Î}ð²r‡ |
1 |
0% |
19.08.2005
05:04:33 |
| larbin_2.6.3 (crawler@ip2site.com) |
1 |
0% |
20.08.2005
20:14:20 |
| InfociousBot (+http://corp.infocious.com/tech_crawler.php) |
1 |
0% |
22.08.2005
11:39:38 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; QXW0339m; MSIECrawler) |
1 |
0% |
22.08.2005
18:57:29 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;
Wanadoo042NLPP01HCFFFFFFEC; SV1; .NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
28.08.2005
21:56:15 |
| schibstedsokbot (compatible; Mozilla/5.0; MSIE 5.0; FAST FreshCrawler
6; Contact: webcrawl@schibstedsok.no;) |
1 |
0% |
01.09.2005
11:52:23 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Arcor 5.004;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
07.09.2005
16:12:15 |
| NuSearch Spider www.nusearch.com |
1 |
0% |
17.09.2005
07:50:45 |
| Mozilla/5.0 (compatible; heritrix/1.0 +http://metacarta.com) |
1 |
0% |
21.09.2005
07:29:11 |
| findlinks/0.975 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
22.09.2005
15:24:01 |
| HeinrichderMiragoRobot (http://www.miragorobot.com/scripts/deinfo.asp) |
1 |
0% |
25.09.2005
08:09:09 |
| WebSearch.COM.AU/4.0 (The Australian Search Engine;
http://WebSearch.COM.AU; Dez@WebSearch.COM.AU) |
1 |
0% |
27.09.2005
06:21:58 |
| LocalcomBot/1.2 (+http://www.local.com/bot.htm) |
1 |
0% |
27.09.2005
22:03:48 |
| ********** (***************; ********; Geht keinen was an!; .NET CLR
1.1.4322; MSIECrawler) |
1 |
0% |
29.09.2005
13:09:17 |
| ICrawl (siqi.wang@gmail.com) |
1 |
0% |
29.09.2005
18:24:49 |
| EverbeeCrawler |
1 |
0% |
30.09.2005
13:47:20 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Strato DSL;
.NET CLR 1.1.4322; Alexa Toolbar) |
1 |
0% |
03.10.2005
23:56:46 |
| Wget/1.9+cvs-dev |
1 |
0% |
04.10.2005
11:30:12 |
| larbin_2.6.3 (aol@aol.com) |
1 |
0% |
07.10.2005
10:49:07 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; i-NavFourF;
MSIECrawler) |
1 |
0% |
07.10.2005
11:34:08 |
| Mozilla/5.0 (compatible; heritrix/1.4.0 +http://www.offis.de) |
1 |
0% |
07.10.2005
21:39:31 |
| NutchCVS/0.06-dev (http://www.nutch.org/docs/en/bot.html;
rhwarren+nutch@uwaterloo.ca) |
1 |
0% |
22.10.2005
06:00:29 |
| htdig/3.1.6 (webmaster@museum.com) |
1 |
0% |
25.10.2005
08:21:12 |
| FAST Enterprise Crawler 6 used by Crawler GonzoP1 DE
(crawleradmin.t-info@telekom.de) |
1 |
0% |
26.10.2005
04:23:23 |
| WebMiner (Web Miner; http://64.124.122.252/feedback.html) |
1 |
0% |
27.10.2005
18:06:44 |
| ... |
1 |
0% |
30.10.2005
02:23:05 |
| FyberSpider (+http://www.fybersearch.com/fyberspider.php) |
1 |
0% |
31.10.2005
06:37:36 |
| DNSGroup/0.1 (DNS Group Crawler; http://www.dnsgroup.com/;
crawler@dnsgroup.com) |
1 |
0% |
01.11.2005
12:45:12 |
| Ipselonbot/0.46-beta (Ipselon;
http://www.ipselon.com/intl/en/ipselonbot.html;
ipselonbot@ipselon.com) |
1 |
0% |
01.11.2005
13:42:13 |
| Orbiter (+http://www.dailyorbit.com/bot.htm) |
1 |
0% |
01.11.2005
19:50:22 |
| Jakarta Commons-HttpClient/3.0-rc3 |
1 |
0% |
02.11.2005
09:36:40 |
| simon/2.2 |
1 |
0% |
08.11.2005
02:39:02 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_05;
Europe/de) |
1 |
0% |
08.11.2005
17:41:26 |
| OmniExplorer_Bot/4.32 (+http://www.omni-explorer.com) WorldIndexer |
1 |
0% |
11.11.2005
00:17:09 |
| findlinks/1.06 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
12.11.2005
02:22:54 |
| VSE/1.0 (testcrawler@vivisimo.com) |
1 |
0% |
13.11.2005
04:43:12 |
| Mozilla/4.0 (compatible; MSIE 6.0 Windows NT5.1)
(larbin2.6.3@unspecified.mail) |
1 |
0% |
13.11.2005
11:39:32 |
| Ipselonbot/0.53-beta (Ipselon;
http://www.ipselon.com/intl/en/ipselonbot.html;
ipselonbot@ipselon.com) |
1 |
0% |
15.11.2005
06:12:35 |
| VSE/1.0 (testcrawler@hotmail.com) |
1 |
0% |
16.11.2005
01:45:36 |
| yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.3; java 1.4.2_09;
Europe/de) |
1 |
0% |
17.11.2005
15:38:10 |
| findlinks/1.0.8 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
19.11.2005
18:08:00 |
| Mozilla/5.0 (compatible; heritrix/1.5 +http://www.metacarta.com) |
1 |
0% |
20.11.2005
00:23:55 |
| Ipselonbot/1.0-beta (+;
http://www.ipselon.com/intl/en/ipselonbot.html) |
1 |
0% |
28.11.2005
04:00:47 |
| FAST Enterprise Crawler 6 used by HBZ (hbz@hbz.com) |
1 |
0% |
02.12.2005
20:51:06 |
| larbin_2.6.3 (crawler@unknow.com) |
1 |
0% |
04.12.2005
20:37:46 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.12; java 1.5.0_06;
Europe/de) |
1 |
0% |
14.12.2005
15:37:20 |
| Mozilla/5.0 (compatible; Theophrastus/1.2;
+http://users.cs.cf.ac.uk/N.A.Smith/theophrastus.php) |
1 |
0% |
16.12.2005
16:37:40 |
| ccubee/3.7 |
1 |
0% |
16.12.2005
18:18:51 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Strato DSL;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
18.12.2005
13:07:59 |
| g2Crawler (nobody@airmail.net) |
1 |
0% |
20.12.2005
02:13:57 |
| VORTEX/1.0 (+http://marty.anstey.ca/robots/vortex/) |
1 |
0% |
20.12.2005
14:57:49 |
| larbin_2.6.3 (ltaa_web_crawler@groupes.epfl.ch) |
1 |
0% |
22.12.2005
16:42:34 |
| silk/1.0 (+http://www.slider.com/silk.htm)/3.7 |
1 |
0% |
27.12.2005
04:05:03 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461; SV1;
MSIECrawler) |
1 |
0% |
27.12.2005
10:36:56 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.14-skas3-v8.2; java
1.5.0_06; Europe/en) |
1 |
0% |
29.12.2005
12:31:13 |
| EARTHCOM.info/1.99 [www.earthcom.info] |
1 |
0% |
04.01.2006
00:18:24 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_04;
Europe/de) |
1 |
0% |
04.01.2006
17:43:46 |
| RedCell/0.1 (RedCell; telegenetic.net/bot.html;
lhall_at_telegenetic.net) |
1 |
0% |
04.01.2006
22:47:08 |
| gsa-crawler (Enterprise; MID-02068;
michi@digicomp.ch,danko.petrovic@digicomp.ch) |
1 |
0% |
05.01.2006
00:14:03 |
| CSCrawler | homepage:
http://www.kde.cs.uni-kassel.de/lehre/ss2005/googlespam/crawler.html
RPT-HTTPClient/0.3-3 |
1 |
0% |
06.01.2006
04:46:15 |
| WIRE/0.10 (Linux; i686; Bot,Robot,Spider,Crawler) |
1 |
0% |
06.01.2006
14:54:47 |
| plinki/0.1 (you got plinked! (thats a good thing..);
http://www.plinki.com; crawl@plinki.com) |
1 |
0% |
09.01.2006
05:07:21 |
| xirq/0.1-dev (xirq; http://www.xirq.com; xirq@xirq.com) |
1 |
0% |
12.01.2006
11:16:41 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Arcor 5.003;
MSIECrawler) |
1 |
0% |
13.01.2006
01:01:57 |
| findlinks/1.1-a9 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
13.01.2006
13:49:42 |
| WIRE/0.10 (Linux; i686; bot42) |
1 |
0% |
14.01.2006
11:13:38 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8) Gecko/20051111
Firefox/1.5 |
1 |
0% |
25.01.2006
13:09:05 |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.12 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
1 |
0% |
27.01.2006
14:34:14 |
| findlinks/1.1.1-a1 (+http://wortschatz.uni-leipzig.de/findlinks/) |
1 |
0% |
29.01.2006
23:21:31 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.13-15.7-default; java
1.4.2_06; Europe/en) |
1 |
0% |
02.02.2006
08:49:41 |
| ObjectsSearch/0.2 (ObjectsSearch;
http://www.ObjectsSearch.com/bot.html; support@thesoftwareobjects.com) |
1 |
0% |
05.02.2006
00:24:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FDM; .NET CLR
1.1.4322; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
05.02.2006
01:21:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.7.12)
Gecko/20050919 Firefox/1.0.7 |
1 |
0% |
09.02.2006
23:16:13 |
| larbin_test (nobody@airmail.etn) |
1 |
0% |
10.02.2006
18:47:13 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.4.20-021stab028.17.777-enterprise; java 1.5.0_06; Europe/en) |
1 |
0% |
10.02.2006
18:49:43 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; HbTools 4.7.2; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
11.02.2006
19:37:40 |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.13 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
1 |
0% |
17.02.2006
06:13:23 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;
{F1554AEC-66D3-AFA7-3574-608C988FDDC9}; snprtz|dialno; .NET CLR
1.1.4322; MSIECrawler) |
1 |
0% |
17.02.2006
22:49:33 |
| suchpad/1.0 (+http://www.suchpad.de) |
1 |
0% |
19.02.2006
17:49:39 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
1 |
0% |
19.02.2006
20:02:40 |
| HooWWWer/2.1.3 (debugging run) (+http://cosco.hiit.fi/search/hoowwwer/
| mailto:crawler-infohiit.fi) |
1 |
0% |
23.02.2006
02:16:51 |
| yacy (www.yacy.net; v20040602; x86 Windows 2000 5.0; java 1.5.0_06;
Atlantic/de) |
1 |
0% |
25.02.2006
11:40:10 |
| Mozilla/5.0 (Windows;) NimbleCrawler 1.14 obeys UserAgent
NimbleCrawler For problems contact: crawler@healthline.com |
1 |
0% |
28.02.2006
01:47:14 |
| BurstFind Crawler 1.0/0.7.1 (Nutch;
http://lucene.apache.org/nutch/bot.html; crawler@burstfind.com) |
1 |
0% |
01.03.2006
06:56:56 |
| FAST Enterprise Crawler 6 used by Schibsted Sok
(webcrawl@schibstedsok.no) |
1 |
0% |
02.03.2006
10:18:21 |
| Mozilla/5.0 (Windows; U; Win 9x 4.90; ru; rv:1.8.0.1) Gecko/20060111
Firefox/1.5.0.1 |
1 |
0% |
06.03.2006
22:22:24 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.4.27-2-386; java 1.5.0_04;
Europe/en) |
1 |
0% |
10.03.2006
14:07:55 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8) Gecko/20051107
Firefox/1.5 |
1 |
0% |
11.03.2006
15:16:41 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-AT; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
1 |
0% |
14.03.2006
15:38:30 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.1)
Gecko/20060111 Spacefinch Firefox/1.5.0.1 |
1 |
0% |
16.03.2006
09:57:53 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.10; java 1.5.0_06;
US/en) |
1 |
0% |
18.03.2006
08:32:19 |
| Firefox_1.0.6 (kasparek@naparek.cz) |
1 |
0% |
19.03.2006
18:35:30 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.1)
Gecko/20060111 Firefox/1.5.0.1 |
1 |
0% |
20.03.2006
10:34:30 |
| hl_ftien_spider |
1 |
0% |
26.03.2006
23:31:08 |
| Blaiz-Bee/2.00.953 (+http://www.blaiz.net) |
1 |
0% |
27.03.2006
03:33:53 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.1)
Gecko/20060111 Webblaireau (null - #verison#) Firefox/1.5.0.1 |
1 |
0% |
01.04.2006
17:45:41 |
| updated/0.1-beta (updated; http://www.updated.com;
crawler@updated.com) |
1 |
0% |
06.04.2006
18:20:55 |
| NextGenSearchBot 1 (for information visit
http://www.zoominfo.com/NextGenSearchBot) |
1 |
0% |
07.04.2006
20:08:49 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 2.0.50727;
MSIECrawler) |
1 |
0% |
11.04.2006
07:08:58 |
| noyona_0_1 |
1 |
0% |
13.04.2006
00:57:06 |
| Mozdex/0.7.2 (Mozdex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
1 |
0% |
13.04.2006
02:09:29 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
1 |
0% |
17.04.2006
01:33:23 |
| RAMPyBot - www.giveRAMP.com/1.0 (RAMPyBot - www.giveRAMP.com;
http://www.giveramp.com/bot.html; support@giveRAMP.com) |
1 |
0% |
19.04.2006
19:01:22 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-AT; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
1 |
0% |
20.04.2006
00:25:18 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
1 |
0% |
21.04.2006
13:40:18 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
1 |
0% |
21.04.2006
14:54:48 |
| kyluka-get |
1 |
0% |
22.04.2006
02:41:19 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.0.2)
Gecko/20060308 Firefox/1.5.0.2 |
1 |
0% |
22.04.2006
14:19:36 |
| NPBot/3 (NPBot; http://www.nameprotect.com; npbot@nameprotect.com) |
1 |
0% |
24.04.2006
06:28:15 |
| Mozilla/5.0 (compatible; heritrix/1.6.0
+http://www.creativeandlogics.com/) |
1 |
0% |
25.04.2006
06:22:28 |
| RAMPyBot - www.giveRAMP.com/0.1 (RAMPyBot - www.giveRAMP.com;
http://www.giveramp.com/bot.html; support@giveRAMP.com) |
1 |
0% |
26.04.2006
02:19:48 |
| WIRE/0.11 (Linux; i686; Bot42) |
1 |
0% |
27.04.2006
07:03:48 |
| gsa-crawler (Enterprise; GIX-02057; dm@enhesa.com) |
1 |
0% |
05.05.2006
04:13:17 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de-AT; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
1 |
0% |
05.05.2006
10:43:24 |
| GeoBot/version 1.0 |
1 |
0% |
06.05.2006
21:28:24 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
1 |
0% |
08.05.2006
19:26:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
1 |
0% |
09.05.2006
10:48:45 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr-FR; rv:1.7.12)
Gecko/20050919 Firefox/1.0.7 |
1 |
0% |
11.05.2006
08:05:46 |
| Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com;
crawler@crawlly.com) |
1 |
0% |
13.05.2006
03:27:17 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;
{6529BE05-8634-35BA-65DA-B762FB78FE4A}; .NET CLR 1.1.4322;
MSIECrawler) |
1 |
0% |
16.05.2006
20:08:12 |
| Krugle/Krugle,Nutch/0.8+ (Krugle web crawler;
http://www.krugle.com/crawler/info.html; webcrawler@krugle.com) |
1 |
0% |
17.05.2006
19:22:52 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1;
.NET CLR 1.0.3705; MSIECrawler) |
1 |
0% |
18.05.2006
22:50:49 |
| Skywalker/0.1 (Skywalker; anonymous; anonymous) |
1 |
0% |
20.05.2006
15:53:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; Media Center PC 4.0; .NET CLR 2.0.50727; .NET CLR 1.1.4322;
MSIECrawler) |
1 |
0% |
20.05.2006
19:04:51 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.3)
Gecko/20060426 Firefox/1.5.0.3 |
1 |
0% |
24.05.2006
11:01:44 |
| WinkBot/0.06 (Wink.com search engine web crawler;
http://www.wink.com/Wink:WinkBot; winkbot@wink.com) |
1 |
0% |
24.05.2006
14:28:03 |
| Mozilla/4.0 (compatible; MSIE 9.42; Windows 3.11) |
1 |
0% |
25.05.2006
15:38:18 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Avant Browser;
Avant Browser; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
25.05.2006
21:28:35 |
| larbin_2.6.3 (marzia.polito@intel.com) |
1 |
0% |
25.05.2006
22:41:28 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461; .NET CLR
1.0.3705; .NET CLR 1.1.4322) |
1 |
0% |
28.05.2006
18:26:52 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.3) Gecko/20060523
Ubuntu/dapper Firefox/1.5.0.3 |
1 |
0% |
01.06.2006
22:13:45 |
| wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de) |
1 |
0% |
02.06.2006
07:57:10 |
| gzip(gfe) (via translate.google.com) |
1 |
0% |
02.06.2006
11:18:23 |
| Mozilla/5.0 (X11; U; Linux i686; rv:1.8.0.3) Gecko/20060503
Firefox/1.5.0.3 (Swiftfox) |
1 |
0% |
04.06.2006
22:31:37 |
| DataparkSearch/4.40.1 (+http://www.dataparksearch.org/) |
1 |
0% |
07.06.2006
06:02:56 |
| NG-Search/0.90 (NG-SearchBot; http://www.ng-search.com/; ) |
1 |
0% |
12.06.2006
11:57:19 |
| Anonymous/0.0 (Anonymous; http://www.anonymous.com;
noreply@anonymous.com) |
1 |
0% |
13.06.2006
01:28:28 |
| Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5;
http://help.yahoo.com/help/us/ysearch/crawling/crawling-02.html ) |
1 |
0% |
16.06.2006
12:09:29 |
| suchpadbot/1.0 (+http://www.suchpad.de/bot/) |
1 |
0% |
17.06.2006
23:52:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
1 |
0% |
21.06.2006
19:51:22 |
| Mozilla/5.0 (Windows; U; Win 9x 4.90; de; rv:1.8.0.4) Gecko/20060508
Firefox/1.5.0.4 |
1 |
0% |
22.06.2006
22:06:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
1 |
0% |
26.06.2006
10:15:04 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
1 |
0% |
28.06.2006
16:30:20 |
| Mozilla/4.0 (compatible; MyFamilyBot/1.0; http://www.myfamilyinc.com) |
1 |
0% |
29.06.2006
18:32:28 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-2-686; java 1.5.0_07;
GMT+01:00/de) |
1 |
0% |
30.06.2006
17:44:39 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.6.8-022stab070.5-enterprise; java 1.4.2-03; Europe/en) |
1 |
0% |
30.06.2006
21:34:32 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; ezn-ie5-r77-32; FDM;
MSIECrawler) |
1 |
0% |
02.07.2006
21:30:12 |
| Exabot-Test/1.0 |
1 |
0% |
03.07.2006
12:26:52 |
| Mozilla/5.0 (compatible; heritrix/1.6.0 +http://www.worio.com/) |
1 |
0% |
05.07.2006
23:00:27 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1;
.NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
08.07.2006
00:14:48 |
| www.adressendeutschland.de |
1 |
0% |
08.07.2006
14:03:46 |
| Nusearch Spider (www.nusearch.com) |
1 |
0% |
09.07.2006
00:59:03 |
| Mozilla/4.0 (compatible; MSIE 6.0 Windows NT5.1) (someone@aol.com) |
1 |
0% |
10.07.2006
05:51:40 |
| Zeus 15187 Webster Pro V2.9 Win32 |
1 |
0% |
10.07.2006
11:45:44 |
| gonzo1[T] mailto:crawleradmin.t-info@telekom.de |
1 |
0% |
12.07.2006
10:50:07 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.4) Gecko/20060608
Ubuntu/dapper-security Firefox/1.5.0.4 |
1 |
0% |
12.07.2006
12:07:16 |
| Java/1.4.2_09 |
1 |
0% |
13.07.2006
17:32:59 |
| LocalcomBot/1.2.2 (+http://www.local.com/bot.htm) |
1 |
0% |
16.07.2006
02:15:43 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
FunWebProducts; .NET CLR 1.1.4322; HbTools 4.7.1; MSIECrawler) |
1 |
0% |
17.07.2006
18:15:27 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; SIMBAR
Enabled; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
20.07.2006
18:48:10 |
| traazibot/testengine (+http://www.traazi.de) |
1 |
0% |
21.07.2006
23:44:42 |
| Mozilla/5.0 (X11; U; Linux i686 (x86_64); de; rv:1.8.0.4)
Gecko/20060508 Firefox/1.5.0.4 |
1 |
0% |
28.07.2006
11:11:45 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.0.5)
Gecko/20060723 Firefox/1.5.0.5 |
1 |
0% |
01.08.2006
21:09:23 |
| KRetrieve/1.1/dbsearchexpert.com |
1 |
0% |
04.08.2006
17:03:40 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; AtHome033;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
06.08.2006
11:35:35 |
| Mozilla/5.0 (X11; ; Linux i686; rv:1.8.0.5) Gecko/20060731 |
1 |
0% |
08.08.2006
16:46:14 |
| Mozilla/5.0 (X11; U; Linux i686 (x86_64); de; rv:1.8.0.6)
Gecko/20060728 SUSE/1.5.0.6-0.1 Firefox/1.5.0.6 |
1 |
0% |
09.08.2006
05:27:25 |
| Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
1 |
0% |
09.08.2006
15:39:19 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.6) Gecko/20060807
Firefox/1.5.0.6 |
1 |
0% |
09.08.2006
21:58:39 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_07;
Europe/de) |
1 |
0% |
10.08.2006
01:09:02 |
| Mozilla/5.0 (compatible; googlebot/2.1;
+http://www.google.com/bot.html) (googlebot@google.com) |
1 |
0% |
17.08.2006
11:20:20 |
| BilgiBetaBot/0.8-dev (bilgi.com (Beta) ;
http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
1 |
0% |
17.08.2006
23:56:57 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.5)
Gecko/20060719 Firefox/1.5.0.5 |
1 |
0% |
18.08.2006
01:36:48 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Smart Explorer
v6.0 ( Evaluation Period ); HbTools 4.8.0; MSIECrawler) |
1 |
0% |
20.08.2006
13:19:52 |
| MyEngines-Bot (Version: 1.04, powered by www.d-o-m-a-i-n.de
+http://www.d-o-m-a-i-n.de/pfadzurbotseite/bot.html) |
1 |
0% |
20.08.2006
19:34:51 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; nl-NL; rv:1.7.5)
Gecko/20041202 Firefox/1.0 |
1 |
0% |
23.08.2006
21:27:29 |
| ItsyBitsySpidr/0.0.8c (http://blogmonitor.de/misc/itsybitsyspidr) |
1 |
0% |
24.08.2006
16:05:07 |
| MedusaCVS/0.1.0 (Medusa; http://www.site.com/medusa/bot.html;
medusa-agent@site.com) |
1 |
0% |
25.08.2006
13:20:09 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.6.9-022stab078.14-enterprise; java 1.5.0_07; Europe/en) |
1 |
0% |
29.08.2006
18:01:06 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; de; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
1 |
0% |
01.09.2006
15:33:38 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8) Gecko/20051128
SUSE/1.5-0.1 Firefox/1.5 |
1 |
0% |
01.09.2006
21:39:27 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.5) Gecko/20060728
Firefox/1.5.0.5 |
1 |
0% |
03.09.2006
14:12:34 |
| TMCrawler |
1 |
0% |
04.09.2006
20:37:52 |
| sgckbrsu wnRfnbfskejlrhRd |
1 |
0% |
05.09.2006
07:52:26 |
| vvhjbghc9fnl9yyxcrdsf k lyvpfRgcm9m |
1 |
0% |
05.09.2006
08:06:41 |
| ItsyBitsy/0.0.8c (http://blogmonitor.de/misc/itsybitsy) |
1 |
0% |
07.09.2006
15:39:54 |
| spglogxtprip1g 1ude mkxj |
1 |
0% |
08.09.2006
09:58:48 |
| Wget/1.10 |
1 |
0% |
10.09.2006
15:02:22 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.6)
Gecko/20060728 (CK-obertuerke) Firefox/1.5.0.6 |
1 |
0% |
12.09.2006
20:18:27 |
| BilgiBetaBot/0.8-dev/0.8-dev (bilgi.com (Beta);
http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
1 |
0% |
15.09.2006
22:20:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5 #PHI#~ |
1 |
0% |
22.09.2006
12:27:15 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; iebar;
InfoPath.1; MSIECrawler) |
1 |
0% |
22.09.2006
22:33:11 |
| SrevBot |
1 |
0% |
27.09.2006
06:40:30 |
| miniRank/2.0 (miniRank; http://minirank.com/; website ranking engine) |
1 |
0% |
29.09.2006
07:23:12 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; onlineTV;
www.cdesign.de; .NET CLR 2.0.50727; InfoPath.1; MSIECrawler) |
1 |
0% |
01.10.2006
13:19:22 |
| HooWWWer/2.3.0 (debugging run) (+http://cosco.hiit.fi/search/hoowwwer/
| mailto:crawler-infohiit.fi) |
1 |
0% |
02.10.2006
20:18:03 |
| msnbot-Products/1.0 (+http://search.msn.com/msnbot.htm) |
1 |
0% |
03.10.2006
08:08:42 |
| yacy (www.yacy.net; v20040602; ppc Linux 2.6.15-27-powerpc; java
1.5.0; Europe/de) |
1 |
0% |
04.10.2006
06:29:52 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.7) Gecko/20060921
Ubuntu/dapper-security Firefox/1.5.0.7 |
1 |
0% |
04.10.2006
15:16:48 |
| Shim-Crawler(Mozilla-compatible;
http://www.logos.ic.i.u-tokyo.ac.jp/crawl/;
crawl@logos.ic.i.u-tokyo.ac.jp) |
1 |
0% |
04.10.2006
17:03:30 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.16.13-xenU; java
1.5.0_06; UTC/en) |
1 |
0% |
04.10.2006
20:31:14 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Media Center
PC 3.0; .NET CLR 1.0.3705; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
05.10.2006
10:01:41 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
1 |
0% |
05.10.2006
19:28:57 |
| Mozilla/5.0 (compatible; nextthing.org/1.0;
+http://www.nextthing.org/bot) |
1 |
0% |
07.10.2006
05:07:30 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
1 |
0% |
09.10.2006
14:34:58 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
1 |
0% |
12.10.2006
22:24:29 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
1 |
0% |
15.10.2006
14:44:32 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; .NET CLR 2.0.50727; InfoPath.2) |
1 |
0% |
17.10.2006
00:19:59 |
| yacy (www.yacy.net; v20040602; ppc Mac OS X 10.4.8; java 1.5.0_06;
Europe/de) |
1 |
0% |
17.10.2006
00:29:20 |
| yacy (www.yacy.net; v20040602; i386 Mac OS X 10.4.8; java 1.5.0_06;
Europe/de) |
1 |
0% |
17.10.2006
16:41:47 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.7) Gecko/20060909
Firefox/1.5.0.7 |
1 |
0% |
17.10.2006
18:58:39 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; nl; rv:1.8.0.6)
Gecko/20060728 Firefox/1.5.0.6 |
1 |
0% |
18.10.2006
19:36:26 |
| Mozilla/5.0 (Windows; U; Win98; en-US; rv:1.8.0.7) Gecko/20060909
Firefox/1.5.0.7 |
1 |
0% |
18.10.2006
20:08:57 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.8.0.7) Gecko/20060911
SUSE/1.5.0.7-1.2 Firefox/1.5.0.7 |
1 |
0% |
19.10.2006
14:14:34 |
| nicebot |
1 |
0% |
30.10.2006
21:41:40 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.0.7)
Gecko/20060909 Firefox/1.5.0.7 |
1 |
0% |
03.11.2006
15:11:50 |
| MJ12bot/v1.1.0
(http://majestic12.co.uk/bot.php?+)&I=6FEB9BB768CD40E33BD285923194C7EA
-543D4D99456BF56A-F0E09BC7C7A3205D |
1 |
0% |
05.11.2006
07:30:03 |
| Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html;
info@szukacz.pl) |
1 |
0% |
07.11.2006
00:22:14 |
| Nutch/Nutch-0.8.1 |
1 |
0% |
07.11.2006
02:43:27 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; de; rv:1.8.1) Gecko/20061010
Firefox/2.0 |
1 |
0% |
09.11.2006
00:08:31 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1)
Gecko/20061010 Firefox/2.0 |
1 |
0% |
11.11.2006
02:54:49 |
| &I=901F26CF39D60DF16A1C0D3498941C9B-28FDC445CFE66EA8-991F73320F8757D6-
www.christoph-bachner.net |
1 |
0% |
21.12.2006
12:56:56 |
| Mozilla/4.0 (compatible; MyFamilyBot/1.0;
http://www.ancestry.com/learn/bot.aspx; SearchBot@MyFamilyInc.com) |
1 |
0% |
22.12.2006
21:24:09 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.1)
Gecko/20061204 Firefox/2.0.0.1 |
1 |
0% |
23.12.2006
01:20:13 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.18-3-686; java 1.5.0_08;
GMT+01:00/de) |
1 |
0% |
26.12.2006
11:26:39 |
| Vacobot; (+http://vaco.ws/bot.html) |
1 |
0% |
26.12.2006
14:00:14 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-10-386; java
1.5.0_08; Europe/de) |
1 |
0% |
28.12.2006
12:01:53 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; freenet.de frndial 5.0; MSIECrawler) |
1 |
0% |
30.12.2006
16:46:08 |
| Mozilla/5.0 (compatible; Heritrix/1.8.0 +http://www.hanzoarchives.com) |
1 |
0% |
31.12.2006
12:06:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; SIMBAR
Enabled; SIMBAR=0; SIMBAR={69E4F465-9BFF-4b8b-A3B3-D99203D8AFE9};
HbTools 4.7.7; .NET CLR 1.1.4322; MEGAUPLOAD 1.0; MSIECrawler) |
1 |
0% |
01.01.2007
20:41:01 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_09;
Europe/de) |
1 |
0% |
04.01.2007
21:05:58 |
| BlogMyWay.Net/BlogMyWay-0.8.1 (admin@blogmyway.org) |
1 |
0% |
12.01.2007
11:40:29 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.16-rc6-060319a; java
1.4.2-03; Europe/en) |
1 |
0% |
13.01.2007
19:37:00 |
| kitty/Nutch-0.8.1 (kitty; http://lucene.apache.org/nutch/;
sz603@uow.edu.au) |
1 |
0% |
16.01.2007
19:37:35 |
| &I=3BA4B6B151D9F2063F2C256D8111A7D8-28FDC445CFE66EA8-991F73320F8757D6-
www.christoph-bachner.net |
1 |
0% |
18.01.2007
14:49:54 |
| iSearch/2.16 |
1 |
0% |
21.01.2007
19:15:09 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-10-generic; java
1.4.2-03; Europe/en) |
1 |
0% |
21.01.2007
21:45:44 |
| kobe_university_search/Nutch-0.8.1 (kobe_university_search;
http://www.ai.cs.scitec.kobe-u.ac.jp/~yuu/file/kobe_university.txt;
yuu at ai dot cs dot scitec dot kobe-u dot ac dot jp) |
1 |
0% |
24.01.2007
19:00:25 |
| Mozilla/5.0 (compatible; seek365 http://www.seek365.de) |
1 |
0% |
28.01.2007
08:28:13 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
2.0.50727; InfoPath.1; MSIECrawler) |
1 |
0% |
29.01.2007
16:51:15 |
| gonzo1[D] +http://www.suchen.de/popups/faq.jsp |
1 |
0% |
30.01.2007
00:34:17 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; MSIECrawler) |
1 |
0% |
07.02.2007
18:45:33 |
| Mozilla/4.0 (compatible; MSIE 5.5; Windows 98; Win 9x 4.90;
FunWebProducts; MSIECrawler) |
1 |
0% |
11.02.2007
10:51:22 |
| hl_ftien_spider_v1.1 |
1 |
0% |
11.02.2007
17:26:24 |
| FAST Enterprise Crawler 6 used by Pages Jaunes
(fastadmin@pagesjaunes.fr) |
1 |
0% |
12.02.2007
12:20:51 |
| Mozdex/0.7.1 (Mozdex; http://www.mozdex.com/bot.html;
spider@mozdex.com) |
1 |
0% |
12.02.2007
12:35:58 |
| yacy (www.yacy.net; v20040602; i386 FreeBSD 5.5-RC1; java 1.4.2-p7;
Europe/en) |
1 |
0% |
14.02.2007
15:47:23 |
| &I=B179EAEAA296AAEB8E0E041B7F27698D-28FDC445CFE66EA8-991F73320F8757D6-
www.christoph-bachner.net |
1 |
0% |
16.02.2007
14:51:11 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.4.27-2-386; java 1.5.0_11;
Europe/de) |
1 |
0% |
17.02.2007
15:48:28 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.0.3705; FDM; MSIECrawler) |
1 |
0% |
18.02.2007
15:00:03 |
| KBeeBot/0.5 Robot |
1 |
0% |
18.02.2007
17:23:28 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR
1.1.4322; InfoPath.1; .NET CLR 2.0.50727; MSIECrawler) |
1 |
0% |
19.02.2007
12:43:13 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.15.4; java 1.5.0_06;
Europe/en) |
1 |
0% |
20.02.2007
03:58:56 |
| yacy (www.yacy.net; v20040602; i386 Linux
2.6.16.20-vs2.0.2-rc22-lsgtux0; java 1.4.2-02; Europe/en) |
1 |
0% |
20.02.2007
04:04:11 |
| TsWeb/Nutch-0.8.1 (TSWeb; tswebtek.com; admin@tswebtek.com) |
1 |
0% |
23.02.2007
13:49:19 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.15-27-386; java
1.4.2-02; Pacific/de) |
1 |
0% |
27.02.2007
03:37:47 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.2)
Gecko/20070219 Firefox/2.0.0.2 |
1 |
0% |
02.03.2007
16:11:14 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.5.0_11;
Europe/de) |
1 |
0% |
02.03.2007
19:38:34 |
| DataparkSearch/4.43 (+http://dataparksearch.org/bot) |
1 |
0% |
11.03.2007
13:11:08 |
| shaboyi spider |
1 |
0% |
13.03.2007
09:29:38 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.21-rc2; java 1.5.0_09;
Europe/de) |
1 |
0% |
16.03.2007
09:43:00 |
| Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com) |
1 |
0% |
20.03.2007
12:53:52 |
| larbin_2.6.1 (larbin2.6.1@unspecified.mail) |
1 |
0% |
21.03.2007
00:36:18 |
| sogou web spider http://www.sogou.com/docs/help/webmasters.htm#07 |
1 |
0% |
28.03.2007
17:42:07 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.17-11-generic; java
1.5.0_07; Europe/en) |
1 |
0% |
31.03.2007
11:01:43 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.4.34; java 1.6.0;
Europe/en) |
1 |
0% |
01.04.2007
22:26:37 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera
8.01/Nutch-0.8.1 (http://lucene.apache.org/nutch/about.html;
http://lucene.apache.org/nutch/bot.html; mail@dev.null) |
1 |
0% |
06.04.2007
04:39:06 |
| locallytargetbot/locallybotV2 (locallybotV2;
http://www.locallytarget.com; bot@locallytarget.com) |
1 |
0% |
12.04.2007
07:09:02 |
| tellbaby/Nutch-1.0-dev (http://www.tellbaby.com) |
1 |
0% |
17.04.2007
20:20:48 |
| LocalcomBot/1.3.0 (+http://www.local.com/bot.htm) |
1 |
0% |
18.04.2007
00:36:19 |
| Java/1.6.0_01 |
1 |
0% |
19.04.2007
12:33:51 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.14.2-rootserver; java
1.4.2-03; Europe/en) |
1 |
0% |
02.05.2007
21:10:39 |
| yacy (www.yacy.net; v20040602; x86 Windows XP 5.1; java 1.6.0_01;
Europe/en) |
1 |
0% |
02.05.2007
21:11:43 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.15-1-686; java 1.5.0_04;
Europe/en) |
1 |
0% |
02.05.2007
21:11:47 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.18-4-vserver-k7; java
1.5.0_10; Europe/en) |
1 |
0% |
03.05.2007
08:28:06 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; InfoPath.1;
MSIECrawler) |
1 |
0% |
03.05.2007
14:56:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; DigExt) |
1 |
0% |
05.05.2007
05:49:22 |
| Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at
isara dot org) |
1 |
0% |
05.05.2007
18:45:07 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; MyIE2; .NET CLR
1.1.4322; .NET CLR 1.0.3705) |
1 |
0% |
05.05.2007
20:09:59 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.8-24.25-smp; java
1.4.2_11; Europe/de) |
1 |
0% |
05.05.2007
23:43:02 |
| Crawler0.1 |
1 |
0% |
06.05.2007
12:01:42 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.16.13-4-smp; java
1.6.0_01; Europe/de) |
1 |
0% |
10.05.2007
02:38:09 |
| my-heritrix-crawler(+http://mywebsite.com) |
1 |
0% |
10.05.2007
23:44:10 |
| iSEEKbot/iSEEKbot-0.9-dev (http://beta.iseek.com/iseekbot.html; bot at
iseek dot com) |
1 |
0% |
13.05.2007
06:36:48 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Arcor 5.006;
SU 3.002; MSIECrawler) |
1 |
0% |
17.05.2007
17:36:12 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; 1&1 Internet AG by
USt; MSIECrawler) |
1 |
0% |
17.05.2007
17:42:15 |
| Blaiz-Bee/2.00.8315 (BE Internet Search Engine
http://www.rawgrunt.com) |
1 |
0% |
21.05.2007
20:10:24 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.18; java 1.5.0_06;
GMT+01:00/en) |
1 |
0% |
23.05.2007
14:33:49 |
| ydeywjqggarmtah dj swmayouiqc7 S |
1 |
0% |
24.05.2007
07:23:36 |
| Jakarta Commons-HttpClient/3.0.1 |
1 |
0% |
27.05.2007
02:21:38 |
| wectar/Nutch-0.9 (nectar extracted form the glorious web;
http://goosebumps4all.net/wectar; see website) |
1 |
0% |
29.05.2007
02:15:47 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.20-16-generic; java
1.4.2-02; GMT+02:00/fi) |
1 |
0% |
31.05.2007
22:37:25 |
| flatlandbot/flatlandbot (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot.php;
jason@flatlandindustries.com) |
1 |
0% |
02.06.2007
23:25:01 |
| Mozilla/5.0 (compatible; MileNSbot/0.1beta;
http://www.milens.net/robotstxt.html) |
1 |
0% |
04.06.2007
13:50:25 |
| Mozilla/4.0 (compatible; bogospider; Linux) |
1 |
0% |
09.06.2007
08:46:09 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
FunWebProducts; .NET CLR 1.1.4322; ZangoToolbar 4.8.3; HbTools 4.8.4;
MSIECrawler) |
1 |
0% |
12.06.2007
19:46:52 |
| yodaoice |
1 |
0% |
16.06.2007
11:29:43 |
| gsa-crawler-upgrade-config (Enterprise; C4-JN7MLGG2WLJAA;) |
1 |
0% |
17.06.2007
07:34:38 |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://newtestbabes.com) |
1 |
0% |
21.06.2007
07:18:48 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; +http://newb.com)
Gecko/20070508 Firefox/1.5.0.12 |
1 |
0% |
22.06.2007
09:08:22 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/419 (KHTML,
like Gecko) Safari/419.3 |
1 |
0% |
26.06.2007
13:35:37 |
| Lynx/2.8rel.3 libwww-FM/2.14 |
1 |
0% |
30.06.2007
19:18:03 |
| Mozilla/5.0 (compatible; heritrix/1.12.0
+http://aleph-webservices.com) |
1 |
0% |
03.07.2007
23:34:38 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.9-023stab043.1-smp; java
1.5.0_03; Europe/en) |
1 |
0% |
04.07.2007
00:52:12 |
| WebAlta Crawler/1.3.34
(http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows
NT 5.1; ru-RU) |
1 |
0% |
04.07.2007
12:14:48 |
| User-Agent: NokiaN70/. FASTMobileCrawl/6.6 Profile/MIDP-2.0
Configuration/CLDC-1.1 |
1 |
0% |
07.07.2007
13:07:28 |
| NutchCVS/Nutch-0.9 (Nutch; http://lucene.apache.org/nutch/bot.html;
nutch-agent@lucene.apache.org) |
1 |
0% |
08.07.2007
10:07:19 |
| DataparkSearch/4.46 (+http://dataparksearch.org/bot) |
1 |
0% |
14.07.2007
01:19:26 |
| xxyyzz |
1 |
0% |
14.07.2007
03:04:52 |
| infomisa/Nutch-0.9 |
1 |
0% |
19.07.2007
15:51:28 |
| Spock Crawler (http://www.spock.com/crawler) |
1 |
0% |
22.07.2007
02:04:29 |
| abc/Nutch-0.9-dev (abc; http://abc#11.us; abc at abc dot com) |
1 |
0% |
23.07.2007
03:17:35 |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322;
.NET CLR 2.0.50727; .NET CLR 3.0.04506.30) |
1 |
0% |
23.07.2007
11:25:22 |
| yacy (www.yacy.net; v20040602; x86 Windows 2003 5.2; java 1.6.0_02;
Europe/de) |
1 |
0% |
24.07.2007
04:12:17 |
| ActiveAthleteCrawl/0.7.2 (ActiveAthlete Search Bot;
http://www.activeathletesearch.com/; nutch-agent@lucene.apache.org) |
1 |
0% |
26.07.2007
00:19:28 |
| Mozilla/4.0 (compatible; MSIE enviable; DAUMOA/1.0.1; DAUM Web Robot;
Daum Communications Corp., Korea; +http://ws.daum.net/aboutkr.html) |
1 |
0% |
27.07.2007
15:37:56 |
| http://www.information-online.com/ |
1 |
0% |
31.07.2007
03:37:17 |
| NextGenSearchBot 1 (for information visit
http://about.zoominfo.com/About/NextGenSearchBot.aspx) |
1 |
0% |
02.08.2007
00:01:22 |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://www.page-store.com) |
1 |
0% |
12.08.2007
10:33:55 |
| WannesWeb-Group Agent/Nutch-0.9 (Agent de recherche pour le moteur
WannesWeb-Group; www.wannesweb-Greoup.com; agent@wannesweb-group.com) |
1 |
0% |
15.08.2007
03:22:29 |
| FuseBulb.Com |
1 |
0% |
20.08.2007
08:15:11 |
| Mozilla/5.0 (X11; U; Linux i686; de-DE; rv:1.8.1.6) Gecko/20070723
Firefox/2.0.0.1 (Windows) |
1 |
0% |
20.08.2007
18:14:44 |
| Mozilla/5.0 (compatible; heritrix/1.12.0 +http://www.accelobot.com) |
1 |
0% |
23.08.2007
04:07:38 |
| softgardenspider/Nutch-0.9 (softgarden search engine;
www.softgarden.de/search; search at softgarden dot de) |
1 |
0% |
25.08.2007
17:24:22 |
| woriobot (+http://www.worio.com) |
1 |
0% |
28.08.2007
19:24:50 |
| yacy (www.yacy.net; v20040602; x86 SunOS 5.11; java 1.6.0_01;
Europe/de) |
1 |
0% |
01.09.2007
21:17:34 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.20-16-generic; java
1.5.0_11; GMT+01:00/en) |
1 |
0% |
02.09.2007
18:29:07 |
| Robotgenius crawler/Nutch-0.9 (http://robotgenius.net; misc at
robotgenius dot net) |
1 |
0% |
03.09.2007
14:22:54 |
| testnutch/Nutch-1.0-dev (testnutcher; http://private;
none@private.net) |
1 |
0% |
03.09.2007
21:58:26 |
| msnbot/1.0 (+http://search.msn.com/msnbot.htm |
1 |
0% |
04.09.2007
00:59:01 |
| qq5mpk5quwhyjxlyairiagg5j |
1 |
0% |
06.09.2007
12:57:07 |
| Mozilla/5.0 (compatible; Exabot Test/3.0;
+http://www.exabot.com/go/robot) |
1 |
0% |
06.09.2007
16:42:53 |
| SeznamBot/2.0 (+http://fulltext.seznam.cz/) |
1 |
0% |
07.09.2007
15:38:02 |
| Java/1.5.0_01 |
1 |
0% |
08.09.2007
10:16:08 |
| nrsbot/5.0(loopimprovements.com/robot.html) |
1 |
0% |
13.09.2007
06:34:11 |
| sait/Nutch-0.9 (SAIT TEST AGENT; http://www.sait.samsung.co.kr) |
1 |
0% |
15.09.2007
04:43:51 |
| IndyLabs_Marius_Crawler (marius@indylabs.net) |
1 |
0% |
15.09.2007
09:23:49 |
| Sogou Pic
Spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07) |
1 |
0% |
19.09.2007
18:58:26 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.22-ARCH; java 1.6.0_02;
Europe/de) |
1 |
0% |
22.09.2007
00:59:12 |
| Mozilla/5.0 (compatible; heritrix/1.7.0 +http://www.greaterera.com/) |
1 |
0% |
23.09.2007
15:18:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.4)
Gecko/20070515 Firefox/2.0.0.4 (larbin@unspecified.mail) |
1 |
0% |
24.09.2007
08:15:53 |
| disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com;
disco-crawl@discoveryengine.com) |
1 |
0% |
26.09.2007
07:30:53 |
| ASAHA Search Engine Turkey V.001 (http://www.asaha.com/) |
1 |
0% |
30.09.2007
13:55:47 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Media Center
PC 3.0; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Seekmo 10.0.341.0;
MSIECrawler) |
1 |
0% |
06.10.2007
09:57:09 |
| owsBot/0.2 (owsBot; www.oneworldstreet.com; owsBot) |
1 |
0% |
06.10.2007
10:34:25 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
(m_pupil@yahoo.com.cn) |
1 |
0% |
09.10.2007
13:13:21 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.20-16-generic; java
1.6.0; GMT+01:00/de) |
1 |
0% |
10.10.2007
13:23:01 |
| BCNutch/Nutch-0.9 (BrightCloud crawler;
http://www.brightcloud.com/crawler.asp) |
1 |
0% |
15.10.2007
14:30:41 |
| testBOT/0.002 |
1 |
0% |
16.10.2007
08:22:43 |
| MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default) |
1 |
0% |
21.10.2007
05:37:03 |
| Mozilla/5.0 (compatible; EARTHCOM/2.2; +http://enter4u.eu) |
1 |
0% |
23.10.2007
01:31:47 |
| nutch/Nutch-0.9 (+http://www.cityreview.org/crawler/) |
1 |
0% |
26.10.2007
08:29:52 |
| LiveTrans/Nutch-0.9 (maintainer: cobain at iis dot sinica dot edu dot
tw; http://wkd.iis.sinica.edu.tw/LiveTrans/) |
1 |
0% |
27.10.2007
06:11:11 |
| Mozilla/5.0
(compatible;YodaoBot-Image/1.0;http://www.yodao.com/help/webmaster/spi
der/;) |
1 |
0% |
27.10.2007
17:01:19 |
| nestReader/0.2 (discovery; http://echonest.com/reader.shtml; reader at
echonest.com) |
1 |
0% |
29.10.2007
17:18:52 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90; QXW03406;
.NET CLR 1.1.4322; MSIECrawler) |
1 |
0% |
30.10.2007
17:28:00 |
| netseer/Nutch-0.9 (NetSeer, Inc. is a Los Angeles based Internet
startup company.; http://www.ilial.com/crawler; crawl@ilial.com) |
1 |
0% |
01.11.2007
03:13:17 |
| yacy (www.yacy.net; v20040602; ppc Linux 2.6.22-2-powerpc; java 1.5.0;
Europe/de) |
1 |
0% |
01.11.2007
06:44:09 |
| AOL_DAC_Search_Spider/Nutch-0.9 (Demo Thing;
daniel.a.clark@verizon.net) |
1 |
0% |
07.11.2007
10:02:49 |
| LWP::Simple/5.805 |
1 |
0% |
08.11.2007
02:07:20 |
| AOL_Daniel_Clark_Spider/Nutch-0.9 (AOL Search; danielaclark1@aol.com) |
1 |
0% |
09.11.2007
02:49:09 |
| sait-research/Nutch-0.9 |
1 |
0% |
17.11.2007
02:02:21 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.20-16-generic; java
1.5.0_11; Europe/de) |
1 |
0% |
19.11.2007
12:39:01 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.9)
Gecko/20071025 Firefox/2.0.0.9 |
1 |
0% |
20.11.2007
12:33:42 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.22-2-486; java 1.6.0;
GMT+01:00/de) |
1 |
0% |
28.11.2007
02:42:29 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.0.3705; .NET
CLR 1.1.4322; Media Center PC 4.0; InfoPath.2; MEGAUPLOAD 2.0; .NET
CLR 2.0.50727; MSIECrawler) |
1 |
0% |
08.12.2007
02:56:11 |
| IlseBot/1.1 |
1 |
0% |
14.12.2007
06:57:27 |
| Mozilla/5.0 (compatible; D1GArabicEngine/1.0; crawlmaster@d1g.com) |
1 |
0% |
15.12.2007
05:36:54 |
| void/1.0 (void) |
1 |
0% |
15.12.2007
17:01:06 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.0.12)
Gecko/20070508 Firefox/1.5.0.12 |
1 |
0% |
25.12.2007
18:41:14 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.11)
Gecko/20071127 ExaleadToolbar/1.0 Firefox/2.0.0.11 |
1 |
0% |
27.12.2007
19:21:17 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.22-gentoo-r9; java
1.6.0_03; Europe/en) |
1 |
0% |
28.12.2007
17:40:33 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.23-ARCH; java 1.6.0_03;
Europe/de) |
1 |
0% |
03.01.2008
00:09:10 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.21.5; java 1.6.0_01;
GB/en) |
1 |
0% |
03.01.2008
08:10:11 |
| yacy (www.yacy.net; v20040602; PowerPC OS/400 V5R3M0; java 1.5.0;
Europe/de) |
1 |
0% |
19.01.2008
09:59:41 |
| Mozilla/5.0 (compatible; heritrix/1.12.1 +http://newstin.com/) |
1 |
0% |
23.01.2008
08:51:12 |
| Runnk RSS aggregator : http://www.runnk.com/
(hybridwse@runnk.com) |
1 |
0% |
25.01.2008
00:27:55 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.22-3-k7; java 1.5.0_13;
GMT+01:00/de) |
1 |
0% |
27.01.2008
22:25:08 |
| Mozilla/5.0 (compatible; heritrix/2.0.0-RC1 +http://www.aol.com) |
1 |
0% |
30.01.2008
17:15:39 |
| Nokia6680/1.0 ((4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0
Configuration/CLDC-1.1 (botmobi find.mobi/bot.html) ) |
1 |
0% |
02.02.2008
00:08:57 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.18.2-34-default; java
1.5.0_08; Europe/de) |
1 |
0% |
05.02.2008
19:05:20 |
| whiteiexpres/Nutch-0.9 (whiteiWebBot; whiteiexpress.com;
whiteye@kon-x.com) |
1 |
0% |
16.02.2008
17:44:35 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.12)
Gecko/20080201 Firefox/2.0.0.12 |
1 |
0% |
18.02.2008
11:45:06 |
| nnn/ttt (n) |
1 |
0% |
19.02.2008
19:46:36 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.20-16-generic; java
1.6.0; GMT+01:00/en) |
1 |
0% |
23.02.2008
23:11:34 |
| EuripBot/1.0 (+http://www.eurip.com) GetRobots |
1 |
0% |
27.02.2008
07:26:12 |
| yacy (www.yacy.net; v20040602; i386 Linux 2.6.11.4-21.15-smp; java
1.5.0_10; Europe/de) |
1 |
0% |
04.03.2008
10:17:04 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.22.5-31-default; java
1.5.0_12; Europe/de) |
1 |
0% |
04.03.2008
12:06:47 |
| yacy (www.yacy.net; v20040602; i386 Mac OS X 10.5.2; java 1.5.0_13;
Europe/de) |
1 |
0% |
04.03.2008
14:56:26 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.16-2-amd64-k8-smp; java
1.5.0_14; Europe/en) |
1 |
0% |
04.03.2008
15:15:40 |
| Mp3Bot/0.1 (http://mp3realm.org/mp3bot/) |
1 |
0% |
06.03.2008
02:01:43 |
| Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E) |
1 |
0% |
08.03.2008
05:58:14 |
| rooster/Nutch-0.9 (openSource search testing engine; koluta.com;
burger@koluta.com) |
1 |
0% |
09.03.2008
11:45:36 |
| yacy (www.yacy.net; v20040602; amd64 Linux 2.6.22-14-server; java
1.6.0_04; GMT/en) |
1 |
0% |
10.03.2008
10:54:43 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.1.12)
Gecko/20080201 Firefox/2.0.0.12 |
1 |
0% |
11.03.2008
22:51:10 |
| MSIE 7.0/Nutch-1.0-dev |
1 |
0% |
13.03.2008
11:36:45 |
| Sigram/Nutch-1.0-dev (Test agent for Nutch development;
http://www.sigram.com/bot.html; bot at sigram dot com) |
1 |
0% |
14.03.2008
10:05:55 |
| Wauuu Spider/Nutch-0.9 (Wauuu Spider; http://www.wauuu.com;
wauuu@wauuu.com) |
1 |
0% |
14.03.2008
11:06:02 |
| wauuu engine/Nutch-0.9 (wauuu engine; http://www.wauuu.com;
wauuu@wauuu.com) |
1 |
0% |
17.03.2008
16:23:02 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.12)
Gecko/20080201 Firefox/2.0.0.12 |
1 |
0% |
17.03.2008
20:32:00 |
| Mozilla/5.0 (compatible; discobot/1.0;
+http://discoveryengine.com/robot.html) |
1 |
0% |
20.03.2008
17:05:36 |
| huedcqe lbu3olmcahuwofnkSvsuSknkyv |
1 |
0% |
29.03.2008
04:28:40 |
| Gaisbot/3.0+(robot-response@widelab.org;+http://www.widelab.org/robot.
html) |
1 |
0% |
04.04.2008
04:09:48 |
| GOKBOT/Nutch-0.9 (Phd Robot; http://www.yildiz.edu.tr/~gbiricik;
no@reply.com) |
1 |
0% |
06.04.2008
15:29:22 |
| OpenPlaces/Nutch-1.0-dev (OpenPlaces Content Crawler;
http://www.openplaces.com; dnadeau 64th-ascii-char openplaces c o m) |
1 |
0% |
07.04.2008
11:38:56 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.13)
Gecko/20080311 Firefox/2.0.0.13 |
1 |
0% |
11.04.2008
15:20:17 |
| Acoon-Robot 4.0.0RC1 (http://www.acoon.de) |
1 |
0% |
14.04.2008
18:42:55 |
| WebImages 0.3 ( http://herbert.groot.jebbink.nl/?app=WebImages ) |
1 |
0% |
16.04.2008
18:10:03 |
| NameOfAgent (CMS Spider) |
1 |
0% |
17.04.2008
06:52:46 |
| TestBot/TestBot-0.1 (Test bot; 127.0.0.1; webmaster@127.0.0.1) |
1 |
0% |
17.04.2008
21:05:13 |
| Attributor/Dejan-1.0-dev (Test crawler; http://www.attributor.com;
info at attributor com) |
1 |
0% |
19.04.2008
04:49:36 |
| Acoon-Robot 4.0.0RC2 (http://www.acoon.de) |
1 |
0% |
21.04.2008
01:48:27 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; OM MS Search 5.0 Robot
Crawler) |
1 |
0% |
21.04.2008
20:38:45 |
| yacy/0.1 (www.yacy.net; x86 Windows XP 5.1; java 1.6.0_05; Europe/de)
Jakarta Commons-HttpClient/3.1 |
1 |
0% |
23.04.2008
07:28:56 |
| Dillo |
1 |
0% |
23.04.2008
17:26:53 |
| Price Ventura/Nutch-0.9 (Nutch spider; http://www.priceventura.com;
AdministrativeContact) |
1 |
0% |
24.04.2008
08:46:30 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.14)
Gecko/20080404 Firefox/2.0.0.14 |
1 |
0% |
28.04.2008
14:17:49 |
| Eurobot/Nutch-1.0-dev (1.0) |
1 |
0% |
28.04.2008
18:03:35 |
| yacy/0.1 (www.yacy.net; i386 Linux 2.6.18.8-0.9-default; java
1.5.0_15; Europe/en) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
04.05.2008
11:29:48 |
| SanszBot/1.7(http://shop.eurosystems.hu/sanszbot, spider@sansz.org)
(spider@sansz.org) |
1 |
0% |
04.05.2008
20:11:45 |
| larbin_2.6.2 (larbin2.6.2@unspecified.mail) |
1 |
0% |
07.05.2008
18:34:12 |
| ll_bot/Nutch-0.9 (LinkLift Web Crawler) |
1 |
0% |
10.05.2008
18:22:16 |
| MSNPTC/Test (compatible; MSIE 6.0; Windows NT 5.2; MyIE2; .NET CLR
1.1.4322; .NET CLR 1.0.3705) |
1 |
0% |
18.05.2008
00:43:32 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:2.0.0)
Gecko/20050511 Firefox/2.0.0.1 |
1 |
0% |
20.05.2008
03:54:41 |
| user_agent=Mp3Bot/0.1 (http://mp3realm.org/mp3bot/) |
1 |
0% |
25.05.2008
06:56:47 |
| OpenAcoon v4.0.7 (www.openacoon.de) |
1 |
0% |
27.05.2008
09:04:18 |
| crawl test/Nutch-1.0-dev |
1 |
0% |
30.05.2008
06:08:24 |
| yacy/0.591049 (www.yacy.net; x86 Windows 2000 5.0; java 1.6.0_06;
Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
16.06.2008
22:21:59 |
| Mozilla/5.0 (compatible; heritrix/1.14.0 +http://85.214.24.208) |
1 |
0% |
18.06.2008
13:44:13 |
| yacy/0.59104922 (www.yacy.net; i386 Linux 2.6.15-51-server; java
1.5.0_06; Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
21.06.2008
20:11:18 |
| DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; RFCrawler-Mobile/1.0;
+http://www.rfms.jp/crawler.html) |
1 |
0% |
27.06.2008
15:55:30 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.15)
Gecko/20080623 Firefox/2.0.0.15 |
1 |
0% |
02.07.2008
12:35:17 |
| portal/Nutch-0.9 (Please do not forbid, its for your benefit) |
1 |
0% |
03.07.2008
03:35:30 |
| myfirsttest/Nutch-0.8.1 (myfirsttest; http://www.science.uva.nl/;
xzhang1@science.uva.nl) |
1 |
0% |
13.07.2008
15:58:14 |
| Tipiweb/Nutch-0.9 |
1 |
0% |
15.07.2008
06:40:14 |
| OpenWebSpider/0.7 (http://www.openwebspider.org) |
1 |
0% |
16.07.2008
09:57:01 |
| test/Nutch-0.9 (test; test; test) |
1 |
0% |
20.07.2008
14:50:19 |
| yacy/0.5900489 (www.yacy.net; amd64 Linux 2.6.25-gentoo-r6; java
1.6.0_07; Europe/en) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
22.07.2008
11:52:31 |
| yacybot (amd64 Linux 2.6.24-19-generic; java 1.6.0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
02.08.2008
23:25:37 |
| Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.1)
Gecko/20061220 Firefox/2.0.0.1 |
1 |
0% |
03.08.2008
22:28:35 |
| DataparkSearch/4.48 (+http://dataparksearch.org/bot) |
1 |
0% |
07.08.2008
07:29:58 |
| Dumbot(version 0.2 beta - http://www.searchles.com/ Searchles Inc.) |
1 |
0% |
10.08.2008
03:14:16 |
| SiteSucker/2.2.2 |
1 |
0% |
13.08.2008
11:54:48 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.2;
http://www.majestic12.co.uk/bot.php?+) |
1 |
0% |
14.08.2008
00:42:22 |
| Mozilla/5.0 (compatible; heritrix/@VERSION@ +http://www.kingsoft.com) |
1 |
0% |
25.08.2008
17:22:33 |
| intumit/Nutch-1.0-dev |
1 |
0% |
25.08.2008
20:51:13 |
| yacybot (i386 Linux 2.6.24-19-generic; java 1.5.0_15; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
30.08.2008
19:52:02 |
| yacy/0.5900489 (www.yacy.net; i386 Linux 2.6.18-6-686; java 1.6.0_07;
Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
04.09.2008
17:30:15 |
| Biglotron-3.01 (larbin2.6.3@unspecified.mail) |
1 |
0% |
09.09.2008
01:20:34 |
| yacybot (i386 Linux 2.6.24-19-generic; java 1.6.0_06; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
20.09.2008
15:02:26 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.17)
Gecko/20080829 Firefox/2.0.0.17 |
1 |
0% |
25.09.2008
14:37:49 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_03; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
28.09.2008
17:16:19 |
| Mozilla/5.0 (compatible; heritrix/2.0.0-OFFIS +http://www.offis.de) |
1 |
0% |
29.09.2008
04:54:56 |
| yacybot (i386 Mac OS X 10.5.5; java 1.5.0_16; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
29.09.2008
05:14:18 |
| yacybot (amd64 Linux 2.6.24-19-generic; java 1.5.0_15; GMT+01:00/en)
http://yacy.net/bot.html |
1 |
0% |
29.09.2008
05:39:23 |
| htdig/3.1.6-112501 (postmaster@salford.ac.uk) |
1 |
0% |
30.09.2008
18:57:10 |
| yacybot (amd64 Linux 2.6.24-19-generic; java 1.6.0_0; Europe/es)
http://yacy.net/bot.html |
1 |
0% |
01.10.2008
11:07:57 |
| masidani_bot_v0.3 (info@masidani.com) |
1 |
0% |
05.10.2008
14:36:38 |
| yacybot (i386 Linux 2.6.22.5-31-default; java 1.5.0_12; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
06.10.2008
01:21:11 |
| yacybot (i386 Linux 2.6.24-etchnhalf.1-686-bigmem; java 1.6.0_07;
Europe/de) http://yacy.net/bot.html |
1 |
0% |
08.10.2008
05:01:48 |
| beast/Nutch-1.0-dev (agentspider; agent.email.com; beast@gmail.com) |
1 |
0% |
10.10.2008
07:54:27 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.3)
Gecko/2008092417 Firefox/3.0.3 |
1 |
0% |
15.10.2008
18:18:05 |
| ConveraCrawler/0.9e (+http://ews.converasearch.com/crawl.htm) |
1 |
0% |
19.10.2008
06:58:15 |
| yacybot (i386 Linux 2.6.24-19-generic; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
20.10.2008
09:08:19 |
| Mozilla/5.0 (compatible; SuchbaerBot/0.4.X;
+http://bot.suchbaer.de/info.html) |
1 |
0% |
25.10.2008
06:51:22 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.16)
Gecko/20080702 Firefox/2.0.0.16 |
1 |
0% |
25.10.2008
12:50:56 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.8.1.17)
Gecko/20080829 Firefox/2.0.0.17 |
1 |
0% |
28.10.2008
21:18:31 |
| Java/1.5.0_14 |
1 |
0% |
31.10.2008
03:56:06 |
| Nutch/0.9 (OpenX Spider) |
1 |
0% |
02.11.2008
16:00:43 |
| xinyangspider (larbin2.6.3@unspecified.mail) |
1 |
0% |
02.11.2008
20:20:07 |
| Mozilla/5.0 (compatible; SuchbaerBot/0.4;
+http://bot.suchbaer.de/info.html) |
1 |
0% |
12.11.2008
19:19:10 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit (KHTML,
like Gecko) |
1 |
0% |
21.11.2008
08:21:31 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.18)
Gecko/20081029 Firefox/2.0.0.18 |
1 |
0% |
22.11.2008
14:18:18 |
| Toot/Nutch-0.9 (Toot crawler; http://www.toot.ch/blog/ueber-toot/;
crawler@toot.ch) |
1 |
0% |
23.11.2008
13:14:20 |
| yacybot (i386 Linux 2.6.16.54-0.2.5-smp; java 1.5.0_15; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
24.11.2008
17:10:11 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.4)
Gecko/2008102920 Firefox/3.0.4 |
1 |
0% |
25.11.2008
22:03:54 |
| yacybot (amd64 Linux 2.6.16.46-0.12-smp; java 1.5.0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
27.11.2008
20:06:11 |
| gkjkgxifxq7gwbirxyAfqcwsyvui |
1 |
0% |
27.11.2008
21:48:09 |
| copyright sheriff (+http://www.hotel-de.tv) |
1 |
0% |
02.12.2008
12:44:42 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_05; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
02.12.2008
13:03:15 |
| copyright sheriff (+http://www.w9drugs.org) |
1 |
0% |
03.12.2008
23:32:07 |
| CiZilla/Nutch-1.0-dev (CiZilla.com - Complete Internet search engine;
http://www.cizilla.com; crawl@cizilla.com) |
1 |
0% |
08.12.2008
12:44:46 |
| sphsearch.org/Nutch-1.0-dev (www.sphsearch.org; crawler@sphsearch.org) |
1 |
0% |
10.12.2008
19:31:04 |
| LCSG-Crawler/Nutch-0.9 (LCSG-Crawler; http://www.aschoff.nameu;
lionel@aftermath.de) |
1 |
0% |
12.12.2008
03:18:30 |
| yacybot (amd64 Linux 2.6.18-xen-3.1-2-amd64; java 1.5.0_14;
GMT+01:00/de) http://yacy.net/bot.html |
1 |
0% |
13.12.2008
06:30:05 |
| yacy/0.61605391 (www.yacy.net; i386 Linux 2.6.18-6-686; java 1.6.0_10;
Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
16.12.2008
05:30:18 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.5)
Gecko/2008120122 Firefox/3.0.5 |
1 |
0% |
18.12.2008
22:00:48 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows NT) |
1 |
0% |
22.12.2008
17:15:04 |
| yacy/0.61605406 (www.yacy.net; amd64 Linux 2.6.18-xen-3.1-2-amd64;
java 1.5.0_14; GMT+01:00/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
25.12.2008
21:11:03 |
| yacybot (i386 Linux 2.6.27-ARCH; java 1.6.0_11; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
25.12.2008
21:11:35 |
| MnoGoSearch/3.2.43 |
1 |
0% |
28.12.2008
00:11:20 |
| yacy/0.6160541 (www.yacy.net; i386 Linux 2.6.18-6-686; java 1.6.0_10;
Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
04.01.2009
14:56:51 |
| yacybot (i386 Linux 2.6.24-22-generic; java 1.5.0_15; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
05.01.2009
00:39:15 |
| SEO Wang/Nutch-0.9 (Nutch spider; http://peterpuwang.googlepages.com ;
MyEmail) |
1 |
0% |
13.01.2009
14:28:56 |
| Mozilla/3.0 (compatible; PerMan Surfer 3.0; Win95) |
1 |
0% |
16.01.2009
12:40:42 |
| Mozilla/4.78 [en] (Windows NT 5.0; U) |
1 |
0% |
18.01.2009
14:09:43 |
| Mozilla/5.0 (compatible; Abonti/0.8 - http://www.abonti.com) |
1 |
0% |
22.01.2009
05:08:30 |
| Keyword Analyzer 0.6.2 (www.keywordle.com) |
1 |
0% |
22.01.2009
08:26:12 |
| http://hilfe.acont.de/bot.html ACONTBOT |
1 |
0% |
26.01.2009
03:10:36 |
| Mozilla/5.0 (http://textdigger.com) Gecko/20061208 Firefox/2.0.0.1 |
1 |
0% |
31.01.2009
02:53:31 |
| SiteSucker/2.2.3 |
1 |
0% |
31.01.2009
09:35:08 |
| yacybot (i386 Linux 2.6.24-23-server; java 1.6.0_0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
04.02.2009
19:14:24 |
| PRBot/0.1 (+http://www.paulridgway.co.uk/prbot) |
1 |
0% |
06.02.2009
01:50:41 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.6)
Gecko/2009011913 Dealio Toolbar 3.4 Firefox/3.0.6 |
1 |
0% |
09.02.2009
19:05:21 |
| yacybot (i386 Linux 2.6.27-11-generic; java 1.6.0_10; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
17.02.2009
09:03:16 |
| flatlandbot/allspark (Flatland Industries Web Spider;
http://www.flatlandindustries.com/flatlandbot;
jason@flatlandindustries.com) |
1 |
0% |
18.02.2009
21:06:47 |
| yacy/0.7200562 (www.yacy.net; i386 Linux 2.6.18-6-686; java 1.6.0_10;
Europe/de) Jakarta Commons-HttpClient/3.1 |
1 |
0% |
19.02.2009
00:15:20 |
| yacybot (i386 Mac OS X 10.5.6; java 1.5.0_16; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
19.02.2009
08:53:13 |
| yacybot (i386 Linux 2.6.24-23-generic; java 1.6.0_07; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
21.02.2009
01:26:50 |
| net_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
26.02.2009
10:49:31 |
| Nokia6680/1.0 (4.04.07) SymbianOS/8.0 Series60/2.6 Profile/MIDP-2.0
Configuration/CLDC-1.1 (botmobi find.mobi/bot.html find@mtld.mobi) |
1 |
0% |
26.02.2009
14:52:07 |
| unknown (unknown@email.com) |
1 |
0% |
01.03.2009
09:27:49 |
| MSIE 7.0 |
1 |
0% |
06.03.2009
13:55:42 |
| WinWebBot/1.0; (Balaena Ltd, UK);
http://www.balaena.com/winwebbot.html; winwebbot@balaena.com;) |
1 |
0% |
07.03.2009
10:35:01 |
| Windows IE 6 |
1 |
0% |
07.03.2009
21:17:39 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.7)
Gecko/2009021910 Firefox/3.0.7 |
1 |
0% |
11.03.2009
00:11:18 |
| Mozilla/5.0 (compatible; Galbot/1.0; +http://www.galbot.com/bot.html) |
1 |
0% |
13.03.2009
08:43:09 |
| Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html) |
1 |
0% |
14.03.2009
15:08:39 |
| Minitel (sulfu@segfault.fr) |
1 |
0% |
16.03.2009
02:51:22 |
| fr_net_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
17.03.2009
13:44:56 |
| isara-search/Isara-1.0 (A non-profit search engine operated by a
charity organization.; www.isara.org; webmaster@isara.org) |
1 |
0% |
18.03.2009
07:08:43 |
| yacybot (amd64 FreeBSD 7.1-PRERELEASE; java 1.6.0_07; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
18.03.2009
21:06:09 |
| Cowbot/Cowbot-dev (http://cow.com/help/cowbot; cowbot at cow dot com) |
1 |
0% |
20.03.2009
16:56:14 |
| SkyGrid/1.0 (+http://skygrid.com/partners) |
1 |
0% |
27.03.2009
01:35:29 |
| yacybot (amd64 Linux 2.6.24-23-generic; java 1.6.0_07; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
28.03.2009
23:23:28 |
| yacybot (i386 Linux 2.6.27.7-9-pae; java 1.6.0_0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
31.03.2009
12:11:11 |
| yacybot (i386 Linux 2.6.27.19-3.2-pae; java 1.6.0_0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
01.04.2009
23:15:54 |
| yacybot (x86 Windows XP 5.1; java 1.6.0_11; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
02.04.2009
04:02:35 |
| Peter Wang/Nutch-1.0-dev (Nutch spiderman;
http://peterpuwang.googlepages.com ; MyEmail) |
1 |
0% |
04.04.2009
01:04:43 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.1)
Gecko/20061204 Firefox/2.0.0.1 |
1 |
0% |
05.04.2009
19:53:59 |
| BBot (larbin2.6.3@unspecified.mail) |
1 |
0% |
06.04.2009
02:24:55 |
| cn_web_viewer_web (larbin2.6.3@unspecified.mail) |
1 |
0% |
09.04.2009
16:09:48 |
| yacybot (i386 Linux 2.6.18.8.xs5.0.0.10.439; java 1.5.0_14;
GMT+01:00/en) http://yacy.net/bot.html |
1 |
0% |
10.04.2009
14:55:53 |
| SindiceBot (heritrix/2.0.2 +http://sindice.com/developers/bot) |
1 |
0% |
14.04.2009
13:56:07 |
| Spider/5.0 |
1 |
0% |
17.04.2009
17:02:02 |
| Mozilla/5.0 (compatible; Mp3Bot/0.4; +http://mp3realm.org/mp3bot/) |
1 |
0% |
18.04.2009
10:46:05 |
| TsWebBot/TSBOT-0.9 (South Indian/Tamil related index;
http://www.tamilsweb.com; admin@tamilsweb.com) |
1 |
0% |
18.04.2009
17:56:39 |
| SiteGuardBot (support@@siteguard.com) |
1 |
0% |
29.04.2009
13:43:11 |
| Mozilla/5.0 (Windows; U; Windows NT 5.2; ru; rv:1.9.0.9)
Gecko/2009040821 Firefox/3.0.9 |
1 |
0% |
04.05.2009
14:59:56 |
| http://www.uni-koblenz.de/~flocke/robot-info.txt |
1 |
0% |
05.05.2009
20:17:03 |
| 08_800w_web_ag (larbin2.6.3@unspecified.mail) |
1 |
0% |
15.05.2009
05:06:40 |
| net_web (larbin2.6.3@unspecified.mail) |
1 |
0% |
15.05.2009
17:00:59 |
| google_two_web (larbin2.6.3@unspecified.mail) |
1 |
0% |
16.05.2009
08:24:56 |
| research spider[AT]mikelab.net |
1 |
0% |
20.05.2009
02:50:12 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.10)
Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729) |
1 |
0% |
21.05.2009
00:56:17 |
| ru_net_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
26.05.2009
04:59:41 |
| http://bimeon.com vcrawler_BootV10.1.3_Link |
1 |
0% |
27.05.2009
00:42:35 |
| weblab/Nutch-0.9 (weblab testing) |
1 |
0% |
28.05.2009
04:39:47 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.10)
Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729) |
1 |
0% |
02.06.2009
11:14:17 |
| CatchBot/1.0; +http://www.catchbot.com |
1 |
0% |
03.06.2009
02:08:10 |
| ru_org_net_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
07.06.2009
05:03:31 |
| web_av (larbin2.6.3@unspecified.mail) |
1 |
0% |
09.06.2009
12:59:47 |
| vspider |
1 |
0% |
10.06.2009
16:51:22 |
| yacybot (amd64 Linux 2.6.28-12-generic; java 1.6.0_0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
11.06.2009
06:57:21 |
| SHC/Nutch-1.0 (SemanticHacker Crawler;
http://www.semantichacker.com/crawler-info; abuse@semantichacker.com) |
1 |
0% |
13.06.2009
04:04:03 |
| yacybot (i386 Linux 2.6.18-128.1.10.el5xen; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
14.06.2009
11:32:55 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.0.11)
Gecko/2009060215 Firefox/3.0.11 (.NET CLR 3.5.30729) |
1 |
0% |
15.06.2009
20:06:11 |
| yacybot (i386 Linux 2.6.28-12-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
16.06.2009
18:41:36 |
| yacybot (amd64 Linux 2.6.9-023stab048.4-smp; java 1.6.0; GMT/en)
http://yacy.net/bot.html |
1 |
0% |
16.06.2009
20:24:33 |
| Mosilla+(+http://www.lssw365.net/) |
1 |
0% |
19.06.2009
05:58:39 |
| MSIndianWebcrawl |
1 |
0% |
24.06.2009
14:18:24 |
| yacybot (amd64 Linux 2.6.24-23-generic; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
25.06.2009
16:00:57 |
| yacybot (i386 Linux 2.6.28-13-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
25.06.2009
16:05:46 |
| gsa-crawler (Enterprise; M2-FZL5CXEKDA2AA; google_mini@tribalddb.de) |
1 |
0% |
26.06.2009
06:56:40 |
| yacybot (amd64 Linux 2.6.28-11-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
29.06.2009
09:41:36 |
| volverine/Nutch-0.9 (agentspider; beast@mail.com) |
1 |
0% |
01.07.2009
01:43:50 |
| Mozilla/5.0 (compatible; Atomic5 Search; +http://atomic5.com/) |
1 |
0% |
03.07.2009
11:40:56 |
| al_org_net_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
07.07.2009
11:00:57 |
| amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.805 |
1 |
0% |
07.07.2009
19:19:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.0.11)
Gecko/2009060215 Firefox/3.0.11 (.NET CLR 3.5.30729) |
1 |
0% |
07.07.2009
20:15:21 |
| LWP::Simple/5.826 |
1 |
0% |
10.07.2009
00:35:38 |
| slurf/Nutch-1.0 |
1 |
0% |
11.07.2009
19:15:43 |
| al_org_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
12.07.2009
09:01:36 |
| cn_org_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
15.07.2009
14:24:18 |
| ru_org_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
15.07.2009
22:13:00 |
| 20090717_aa_page (larbin2.6.3@unspecified.mail) |
1 |
0% |
21.07.2009
00:08:25 |
| pt_viewer_org (larbin2.6.3@unspecified.mail) |
1 |
0% |
23.07.2009
12:05:55 |
| yacybot (i386 Linux 2.6.24-23-server; java 1.6.0_07; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
24.07.2009
15:36:59 |
| pt_viewer_page (larbin2.6.3@unspecified.mail) |
1 |
0% |
25.07.2009
13:55:44 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Media Center
PC 3.0; .NET CLR 1.0.3705; .NET CLR 2.0.50727; InfoPath.2; WWTClient2;
MSIECrawler) |
1 |
0% |
27.07.2009
16:15:16 |
| Wouah/Nutch-1.0 (http://www.wouah.fr) |
1 |
0% |
30.07.2009
08:33:13 |
| yacybot (amd64 Linux 2.6.28-14-generic; java 1.6.0_14; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
05.08.2009
01:05:25 |
| Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.0.13)
Gecko/2009073022 Firefox/3.0.13 GTB5 (.NET CLR 3.5.30729) |
1 |
0% |
05.08.2009
15:22:47 |
| Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+
(KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419.3
(compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) |
1 |
0% |
06.08.2009
19:42:53 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.2)
Gecko/20090729 Firefox/3.5.2 (.NET CLR 3.5.30729) |
1 |
0% |
16.08.2009
11:46:37 |
| Wget/1.11.4 |
1 |
0% |
16.08.2009
18:33:36 |
| bloo/Nutch-1.0 (bloo; wiki.bloo.com; bloo at bloo dot com) |
1 |
0% |
18.08.2009
03:34:54 |
| pt_viewer_web (larbin2.6.3@unspecified.mail) |
1 |
0% |
20.08.2009
13:39:24 |
| Semager/1.3 http://www.semager.de/blog/semager-bots/ |
1 |
0% |
22.08.2009
20:11:04 |
| Acquia Crawler |
1 |
0% |
28.08.2009
21:03:23 |
| yacybot (amd64 Linux 2.6.28-15-generic; java 1.6.0_14; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
30.08.2009
14:38:27 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2;
.NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media
Center PC 6.0; InfoPath.2) |
1 |
0% |
31.08.2009
21:00:13 |
| yacybot (i386 Linux 2.6.28-15-generic; java 1.6.0_0; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
03.09.2009
23:48:19 |
| Verification metatags
http://referencement.abaabaa.com/add_url_GRATUIT.php : Easy
referencement (version 1.0) |
1 |
0% |
04.09.2009
17:11:30 |
| Mozilla crawl/5.0 (compatible; fairshare.cc +http://fairshare.cc) |
1 |
0% |
04.09.2009
18:08:16 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; SLCC1;
.NET CLR 2.0.50727; Media Center PC 5.0; eSobiSubscriber 2.0.4.16;
.NET CLR 3.5.30729; OfficeLivePatch.1.3; .NET CLR 3.0.30729;
OfficeLiveConnector.1.4) |
1 |
0% |
05.09.2009
12:05:50 |
| WyoBot 1.0 |
1 |
0% |
05.09.2009
21:36:19 |
| toofaan/Nutch-1.0 (http://www.toofaan.com) |
1 |
0% |
12.09.2009
08:14:22 |
| yacybot (i386 Linux 2.6.28-gentoo-r5; java 1.6.0_15; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
12.09.2009
22:31:23 |
| nutch.biz/Nutch-1.0 (nutch.biz; crawler@nutch.biz) |
1 |
0% |
29.09.2009
15:21:44 |
| Codeton Software RSS Bot/1.0 |
1 |
0% |
29.09.2009
21:57:43 |
| LWP::Simple/5.827 libwww-perl/5.831 |
1 |
0% |
30.09.2009
10:18:43 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.1.3)
Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729) |
1 |
0% |
30.09.2009
16:19:04 |
| sphsearch.org/Nutch-1.0 (sphsearch.org; crawler@sphsearch.org) |
1 |
0% |
03.10.2009
21:21:14 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.3)
Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729) |
1 |
0% |
05.10.2009
13:13:29 |
| test/Nutch-1.0 (test; www.w3cool.com; zhangweijie[a]gmail.com) |
1 |
0% |
07.10.2009
16:34:31 |
| librabot/2.0 (+http://search.msn.com/msnbot.htm) |
1 |
0% |
12.10.2009
20:42:59 |
| Liam Clancy/Nutch-1.0 (Nutch; http://www.metafeather.net/ ; Nutch) |
1 |
0% |
27.10.2009
20:22:55 |
| ThumbShots-Bot (+http://www.kfsw.de/) |
1 |
0% |
28.10.2009
02:37:32 |
| yacybot (x86_64 Mac OS X 10.6.1; java 1.6.0_15; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
29.10.2009
21:57:25 |
| yacybot (amd64 Linux 2.6.18-164.6.1.el5; java 1.6.0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
08.11.2009
06:58:59 |
| yacybot (i386 Linux 2.6.26-gentoo-r1; java 1.5.0_16; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
11.11.2009
00:45:30 |
| http://arachnode.net 1.4 |
1 |
0% |
11.11.2009
11:09:33 |
| gonzo1[D] +http://www.suchen.de/faq.html |
1 |
0% |
14.11.2009
05:17:30 |
| Mozilla/5.0 (compatible; heritrix/1.14.3 +http://archive.org) |
1 |
0% |
17.11.2009
16:30:30 |
| ICC-Crawler/2.0 (Mozilla-compatible; ;
http://kc.nict.go.jp/project1/crawl.html) |
1 |
0% |
17.11.2009
17:18:10 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.1.13) |
1 |
0% |
19.11.2009
08:57:02 |
| Zscho.de Crawler/Nutch-1.0-Zscho.de-semantic_patch (Zscho.de Crawler,
collecting for machine learning; http://zscho.de/) |
1 |
0% |
24.11.2009
16:55:41 |
| yacybot (amd64 Windows Vista 6.0; java 1.7.0-ea; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
25.11.2009
18:19:54 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.1.3)
Gecko/20090824 Firefox/3.5.3 GTB5 (.NET CLR 3.5.30729) |
1 |
0% |
07.12.2009
23:59:07 |
| Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot
nl; http://webagent.wise-guys.nl/) |
1 |
0% |
08.12.2009
21:13:24 |
| Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.1.5)
Gecko/20091102 Firefox/3.5.5 |
1 |
0% |
08.12.2009
23:30:14 |
| Mozilla/5.0 (compatible; aiHitBot-DS/1.0; +http://www.aihit.com/) |
1 |
0% |
10.12.2009
10:01:38 |
| TheRarestParser/0.4b (http://rarestblog.com/therarestparser/) |
1 |
0% |
15.12.2009
14:07:02 |
| Orgbybot/OrgbyBot v1.3 (Spider; http://orgby.com/bot/ ; Orgby.com
Search Engine) |
1 |
0% |
24.12.2009
15:10:33 |
| Naveen/Nutch-1.0 (Naveen; http://www.google.org; root@me) |
1 |
0% |
25.12.2009
07:53:47 |
| Jyxobot/1 |
1 |
0% |
05.01.2010
00:04:07 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.6)
Gecko/20091201 Firefox/3.5.6 |
1 |
0% |
06.01.2010
12:25:45 |
| yacybot (i386 Linux 2.6.28-17-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
10.01.2010
06:48:14 |
| Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.1.7)
Gecko/20091221 Firefox/3.5.7 (.NET CLR 3.5.30729) |
1 |
0% |
11.01.2010
22:36:37 |
| L.webis/0.41 (http://webalgo.iit.cnr.it/index.php?pg=lwebis) |
1 |
0% |
15.01.2010
04:14:44 |
| SheenBot/SheenBot-1.0.3 (Sheen web crawler) |
1 |
0% |
22.01.2010
05:21:44 |
| yacybot (amd64 Linux 2.6.32.2-xxxx-std-ipv4-64; java 1.6.0_0;
Europe/en) http://yacy.net/bot.html |
1 |
0% |
27.01.2010
01:15:47 |
| yacybot (x86 Windows 2003 5.2; java 1.6.0_17; Europe/de)
http://yacy.net/bot.html |
1 |
0% |
01.02.2010
09:17:15 |
| Mozilla/5.0 (compatible; dotSemantic/1.0; +http://www.dotsemantic.org) |
1 |
0% |
02.02.2010
21:54:46 |
| yacybot (i386 Linux 2.6.31-18-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
05.02.2010
13:47:51 |
| BlackBerry9000/4.6.0.167 Profile/MIDP-2.0 Configuration/CLDC-1.1
VendorID/102 ips-agent |
1 |
0% |
05.02.2010
23:23:50 |
| yacybot (i386 Linux 2.6.30-gentoo-r6-090907; java 1.6.0_17; GMT/de)
http://yacy.net/bot.html |
1 |
0% |
07.02.2010
17:48:40 |
| Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_8; en-us)
AppleWebKit/531.9 (KHTML, like Gecko) Version/4.0.3
Safari/531.9/Nutch-1.0 |
1 |
0% |
12.02.2010
06:33:41 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2) Gecko/20100115
Firefox/3.6 (.NET CLR 3.5.30729) |
1 |
0% |
14.02.2010
14:39:01 |
| NotGoogleBot/1 |
1 |
0% |
16.02.2010
18:47:15 |
| Mozilla/5.0 (compatible; SuchbaerBot/0.83;
+http://bot.suchbaer.de/info.html) |
1 |
0% |
17.02.2010
02:28:09 |
| AdultsVisit.us/Nutch-1.0 (www.AdultsVisit.us; crawler@AdultsVisit.us) |
1 |
0% |
19.02.2010
17:39:45 |
| Mozilla/5.0 (Windows; U; Windows NT 5.0; ru; rv:1.8.0.10)
Gecko/20070216 Firefox/1.5.0.10 |
1 |
0% |
20.02.2010
21:50:33 |
| https_url_test (larbin2.6.3@unspecified.mail) |
1 |
0% |
24.02.2010
22:08:26 |
| Teragram/SAS Crawler |
1 |
0% |
26.02.2010
04:51:43 |
| es_com_viewer (larbin2.6.3@unspecified.mail) |
1 |
0% |
26.02.2010
22:16:21 |
| cizilla.com/Cizilla-1.0 (CIZILLA - Complete Internet Search Engine;
http://www.cizilla.com; crawl@cizilla.com) |
1 |
0% |
27.02.2010
20:05:48 |
| Test-Fetcher-0.1/Nutch-0.9 (Awesomeness) |
1 |
0% |
02.03.2010
00:01:31 |
| yacybot (amd64 Windows Server 2008 R2 6.1; java 1.6.0_18; Europe/fr)
http://yacy.net/bot.html |
1 |
0% |
04.03.2010
15:52:02 |
| daodao (larbin@unspecified.mail) |
1 |
0% |
05.03.2010
12:58:51 |
| L.webis/0.50 (http://webalgo.iit.cnr.it/index.php?pg=lwebis) |
1 |
0% |
10.03.2010
12:33:27 |
| Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Trident/4.0; .NET
CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR
3.0.04506.648; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729) |
1 |
0% |
17.03.2010
10:20:25 |
| SnapOn Long-Crawl/Nutch-0.9 (CCPV Crawler;
http://thecrawlerproject.com; aherres@gmail.com) |
1 |
0% |
17.03.2010
17:10:58 |
| L.webis/0.53 (http://webalgo.iit.cnr.it/index.php?pg=lwebis) |
1 |
0% |
22.03.2010
00:43:52 |
| SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com;
http://shopsalad.com/en/partners.html; crawler AT shopsalad.com) |
1 |
0% |
22.03.2010
17:58:53 |
| Pannonball/Nutch-1.0-dev (Pannonball Web Crawler Agent;
http://www.pannonball.at; info@onkelhans.at) |
1 |
0% |
23.03.2010
22:27:42 |
| yacybot (x86 Windows 7 6.1; java 1.6.0_18; Europe/es)
http://yacy.net/bot.html |
1 |
0% |
27.03.2010
08:54:58 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.6)
Gecko/20060728 Firefox/1.6 |
1 |
0% |
04.04.2010
22:21:09 |
| yacybot (amd64 Linux 2.6.28-15-generic; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
05.04.2010
07:55:30 |
| Mozilla/5.0 (compatible; cuil/1.14.3 +http://cuil.com) |
1 |
0% |
10.04.2010
19:42:06 |
| MozPlug (bert@secret-wg.org) |
1 |
0% |
15.04.2010
20:57:40 |
| yacybot (amd64 Linux 2.6.26-2-amd64; java 1.6.0_12; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
16.04.2010
04:48:40 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1)
Gecko/20061204 Firefox/2.0.0.1 |
1 |
0% |
17.04.2010
09:52:07 |
| larbin_2.6.3 (zhangfeezju@gmail.com) |
1 |
0% |
17.04.2010
22:19:41 |
| gonzo/1[P] (+http://www.suchen.de/faq.html) |
1 |
0% |
19.04.2010
11:42:55 |
| CatchBot/2.0; +http://www.catchbot.com |
1 |
0% |
23.04.2010
07:22:07 |
| yacybot (amd64 Linux 2.6.32.2; java 1.6.0_17; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
24.04.2010
09:09:06 |
| Mozilla/5.0 (Windows; U; Windows NT 6.0; de; rv:1.9.2.3)
Gecko/20100401 Firefox/3.6.3 ( .NET CLR 3.5.30729) |
1 |
0% |
03.05.2010
10:57:23 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.7)
Gecko/20070914 Firefox/2.0.0.7 |
1 |
0% |
05.05.2010
23:20:16 |
| yacybot (amd64 Linux 2.6.32.2; java 1.6.0_20; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
06.05.2010
18:56:14 |
| Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.2; Trident/4.0; GTB6;
.NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET
CLR 3.5.21022; MS-RTC EA 2; OfficeLiveConnector.1.3;
OfficeLivePatch.0.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.21 |
1 |
0% |
08.05.2010
21:30:08 |
| yacybot (x86 Windows Vista 6.0; java 1.6.0_20; America/en)
http://yacy.net/bot.html |
1 |
0% |
12.05.2010
13:21:38 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/532.5
(KHTML, like Gecko) Chrome/4.0.249.89 Safari/532.5 |
1 |
0% |
15.05.2010
20:03:45 |
| bitlybot |
1 |
0% |
18.05.2010
14:23:49 |
| Mozilla/5.0 (compatible; tradeli.st/1.5rc; http://www.tradeli.st/bot/ |
1 |
0% |
19.05.2010
15:31:24 |
| Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2) Gecko/20100115
Firefox/3.6 GTBDFff GTB7.0 |
1 |
0% |
22.05.2010
09:56:30 |
| www.xexo.it/http://www.xexo.it (Sexy shop completamente automatico -
Il tuo sexy shop di fiducia ; http://www.xexo.it; marketing@xexo.it) |
1 |
0% |
26.05.2010
10:16:17 |
| yacybot (i386 Linux 2.6.18-028stab068.9; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
27.05.2010
06:21:13 |
| PenTest.sg/Nutch-1.1 (www.PenTest.sg; crawler@PenTest.sg) |
1 |
0% |
01.06.2010
19:28:37 |
| Infoaxe./Nutch-0.9 |
1 |
0% |
03.06.2010
10:53:19 |
| ebooksearchtool |
1 |
0% |
05.06.2010
15:57:59 |
| www.xexo.it/http://www.xexo.it (Sexy shop online e automatico - BDSM,
vibratori, falli, vagine, lubrificanti. Il tuo sexy shop di fiducia;
http://www.xexo.it; marketing@xexo.it) |
1 |
0% |
12.06.2010
07:42:36 |
| Mozilla/5.0 (Windows; U; Windows NT 6.1; de; rv:1.9.2.3)
Gecko/20100401 Firefox/3.6.3 |
1 |
0% |
13.06.2010
23:22:42 |
| yacybot (amd64 Linux 2.6.24-ovz006; java 1.6.0_20; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
16.06.2010
16:39:10 |
| Mozilla/5.0 [en] (X11; U; Linux 2.2.15 i686
+http://www.yahoo.com/index.html) |
1 |
0% |
21.06.2010
09:16:39 |
| Mozilla/5.0 (compatible; Moose/1.2; U; Linux i686; de;
+http://www.moose.at/about.php) |
1 |
0% |
24.06.2010
05:33:12 |
| male.com.sg/Nutch-1.1 (www.male.com.sg; crawler@male.com.sg) |
1 |
0% |
25.06.2010
02:27:35 |
| Mozilla/5.0 (X11; U; OpenBSD alpha; en-AU; rv:1.8.1.6) Gecko/20081105
Firefox/2.0.0.6 |
1 |
0% |
25.06.2010
18:23:33 |
| Googlebot/2.1/Nutch-1.1 |
1 |
0% |
28.06.2010
04:25:15 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.6)
Gecko/20100625 Firefox/3.6.6 |
1 |
0% |
05.07.2010
13:10:00 |
| Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.1; compatible;
iCcrawler - iCjobs Stellenangebote Jobs; http://www.icjobs.de)
Gecko/20100401 iCjobs/2.3.1 |
1 |
0% |
07.07.2010
11:41:14 |
| yacybot (amd64 Linux 2.6.26-2-amd64; java 1.6.0_20; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
07.07.2010
21:36:47 |
| yacybot (amd64 Linux 2.6.18-164.15.1.el5xen; java 1.6.0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
07.07.2010
21:37:39 |
| Mozilla/5.0 (compatible; Search17Bot/1.1;
http://www.search17.com/bot.php) |
1 |
0% |
12.07.2010
13:53:38 |
| yacybot (x86_64 Mac OS X 10.6.4; java 1.6.0_20; America/en)
http://yacy.net/bot.html |
1 |
0% |
13.07.2010
14:04:33 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/525.13
(KHTML, like Gecko) Chrome/0.A.B.C Safari/525.13 |
1 |
0% |
15.07.2010
23:26:24 |
| govbot/Nutch-1.1 (Gov bot; none) |
1 |
0% |
25.07.2010
16:09:18 |
| Mozilla/5.0 (compatible; Konqueror/4.2; Linux 2.6.28-11-generic; X11;
i686; en-US, en) KHTML/4.2.2 (like Gecko) |
1 |
0% |
28.07.2010
08:15:11 |
| Mozilla/5.0 (compatible; bixolabs/1.0;
+http://bixolabs.com/crawler/general; crawler@bixolabs.com) |
1 |
0% |
28.07.2010
11:09:27 |
| yacybot (i386 Linux 2.6.32-24-generic-pae; java 1.6.0_18; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
31.07.2010
10:46:19 |
| Arquivo-web-crawler (compatible; heritrix/1.14.3 +http://arquivo.pt) |
1 |
0% |
05.08.2010
05:32:22 |
| yacybot (i386 Linux 2.6.32-21-generic; java 1.6.0_18; Europe/fr)
http://yacy.net/bot.html |
1 |
0% |
05.08.2010
12:07:28 |
| Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 6.0) |
1 |
0% |
07.08.2010
02:57:43 |
| yacybot (i386 Linux 2.6.24-10-pve; java 1.6.0_12; Etc/en)
http://yacy.net/bot.html |
1 |
0% |
08.08.2010
02:18:26 |
| Mozilla 5.0/Metal will never die |
1 |
0% |
12.08.2010
14:38:04 |
| yacybot (i386 Linux 2.6.31-21-generic; java 1.6.0_0; GB-Eire/en)
http://yacy.net/bot.html |
1 |
0% |
14.08.2010
12:29:02 |
| Web Spider/Nutch-0.9 |
1 |
0% |
16.08.2010
06:16:16 |
| DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) |
1 |
0% |
17.08.2010
15:21:28 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; el; rv:1.9.2.8)
Gecko/20100722 Firefox/3.6.8 |
1 |
0% |
20.08.2010
16:07:02 |
| fetch/Nutch-1.0 (TCGfetch; http://fetch.thecyberguardian.com;
TCGEmail) |
1 |
0% |
22.08.2010
16:12:53 |
| IE7 (abc@123.com) |
1 |
0% |
23.08.2010
22:13:25 |
| yacybot (i386 Linux 2.6.32-5-openvz-amd64; java 1.6.0_20; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
24.08.2010
08:07:48 |
| Nutch/Nutch-1.0 (academic purpose; cats.kaist.ac.kr;
smiler82@naver.com) |
1 |
0% |
29.08.2010
14:25:24 |
| yacybot (amd64 Linux 2.6.18-194.8.1.el5; java 1.6.0_0; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
31.08.2010
05:44:21 |
| yacybot (i386 Linux 2.6.32-24-generic; java 1.6.0_18; Europe/en)
http://yacy.net/bot.html |
1 |
0% |
31.08.2010
05:44:22 |
| Mozilla/5.0 (X11; U; Linux i686; de; rv:1.9.0.1; compatible; iCjobs
Stellenangebote Jobs; http://www.icjobs.de) Gecko/20100401
iCjobs/3.2.3 |
1 |
0% |
01.09.2010
08:12:31 |