Web Site Trespassers

Robots Exclusion Standards

Robots, also known as spiders or crawlers, are programs that traverse a web site structure by following hyperlinks contained in the site's pages.  They are used by search engines to index documents and by scientific establishments for research purposes.  They are also widely used maliciously to harvest e-mail addresses and private information which can be sold to target spam e-mail.  Robots FAQ »

The Standard for Robot Exclusion is a No Entry protocol that marks designated areas of a web site as excluded from analysis by web robots.  The Robots META tag Standard is an in-page directive that indicates if a web page should be indexed or its links followed.  These standards are only conventions but well behaved robots should abide by them.

Trespassers Trapped Here

This is a list of robots detected within scriptit.co.uk which have ignored both the Robots Exclusion Standard and the Robots META Tag Standard:

DateIPDeclared User Agent
24-06-10 15:10:48207.126.167.114Twisted PageGetter
18-06-10 11:41:34178.162.68.60
13-06-10 07:24:58173.212.206.186Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
08-06-10 14:38:45216.0.96.130Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
02-06-10 20:40:49168.8.146.21Java/1.6.0_20
01-06-10 03:50:18213.5.71.85Opera/9.80 (Windows NT 5.2; U; ru) Presto/2.5.24 Version/10.53
31-05-10 10:28:2468.213.130.179Java/1.6.0_20
27-05-10 19:37:2174.12.40.199Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en)
27-05-10 04:26:0993.190.139.15Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
16-05-10 01:14:1682.80.230.228Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
03-05-10 23:31:22201.235.137.62Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
01-05-10 05:33:23209.107.217.10Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-04-10 17:32:5961.47.34.11Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
17-04-10 16:59:4172.249.45.161Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)
13-04-10 22:44:5338.108.67.27SBIder/Nutch-1.0-dev (http://www.sitesell.com/sbider.html)
10-04-10 06:34:5166.96.220.69Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/)
08-04-10 11:31:4794.228.220.91Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
03-04-10 22:04:0791.214.44.11Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; XMPP Tiscali Communicator v.10.0.2; .NET CLR 2.0.50727)
29-03-10 20:52:13212.95.54.122Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-03-10 14:29:22188.221.229.8Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322)
09-03-10 10:29:2191.214.45.47Mozilla 5.0 (Windows; U; Windows NT 5.0; us; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6)
08-03-10 11:32:4891.214.45.48Mozilla 5.0 (Windows; U; Windows NT 5.0; us; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6)
02-03-10 02:30:2291.214.44.182Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-02-10 11:23:3967.23.13.22Java/1.6.0_07
26-02-10 16:27:3089.149.244.240Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-02-10 06:33:32188.92.75.14Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-02-10 06:49:36173.45.242.245BoboSpider
13-02-10 14:41:29203.6.203.75
13-02-10 03:28:55194.199.90.124Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-02-10 03:22:2189.31.128.132Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-02-10 02:16:18211.14.142.130Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
07-02-10 21:12:3794.75.229.132Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/)
01-02-10 16:51:5767.23.206.242Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.0.1) Gecko/20060124 Firefox/1.5.0.1
29-01-10 10:03:39189.115.138.192Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)
27-01-10 15:10:4489.248.172.58Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
27-01-10 01:19:03203.6.203.71
20-01-10 10:59:11188.121.49.11Abrave Spider v2.6 Robot 7 (http://robot.abrave.co.uk)
17-01-10 08:44:38188.92.75.82Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-01-10 00:08:5889.149.244.21Mozilla/4.0 (compatible; MSIE 5.0; Linux 2.4.20-4GB i686) [en]
09-01-10 09:50:4686.161.9.108Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
07-01-10 13:55:5462.190.148.25Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 4.0) Opera 7.0 [en]
01-01-10 12:18:3665.55.109.18Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648)
27-12-09 16:10:3989.149.254.73Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
26-12-09 01:06:50206.51.231.26User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
23-12-09 17:13:3066.220.18.178CC-rget/5.818 libwww-perl/5.823
23-12-09 14:21:53112.197.0.113Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
21-12-09 18:39:4391.214.44.91Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
03-12-09 18:38:20209.160.65.104Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; InfoPath.2)
01-12-09 18:39:16203.6.203.72
01-12-09 04:57:5289.248.172.14Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
23-11-09 00:42:00217.44.140.217Mozilla/3.0 (compatible)
20-11-09 13:30:54201.116.58.221Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
11-11-09 13:33:59168.10.168.61Mozilla/3.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
10-11-09 22:00:43200.30.86.109Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
09-11-09 07:30:1672.167.97.33Abrave Spider v2.5 Robot 2 (http://robot.abrave.co.uk)
08-11-09 00:31:5161.178.81.100Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
06-11-09 19:28:1789.253.70.223Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
05-11-09 10:50:51124.115.1.62Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
03-11-09 03:55:39193.104.22.25Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50
29-10-09 04:08:1265.55.109.183Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4325; .NET CLR 2.0.40607)
28-10-09 01:36:14114.80.93.71Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
21-10-09 03:07:2572.46.136.2Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-10-09 14:58:3738.105.83.13Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)
09-10-09 23:52:5793.174.93.222Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
08-10-09 17:23:4181.153.61.109Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6; .NET CLR 1.1.4322; .NET CLR 2.0.50727; MS-RTC LM 8; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)
08-10-09 14:19:44194.8.75.155Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
05-10-09 22:04:3591.214.44.121Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
30-09-09 12:54:4561.114.198.63Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
30-09-09 07:01:33115.238.66.254Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
28-09-09 00:31:1389.178.207.237Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
26-09-09 10:24:3381.102.74.121Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
25-09-09 07:21:2891.214.45.89Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
18-09-09 07:18:4259.99.139.2
13-09-09 21:15:0838.105.83.6Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)
11-09-09 11:23:2887.112.75.227Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt)
02-09-09 16:35:2572.196.11.73Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
30-08-09 16:56:1091.214.46.18Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-08-09 15:20:41115.238.66.244Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
27-08-09 23:54:3365.55.207.122msnbot/2.0b (+http://search.msn.com/msnbot.htm)
19-08-09 13:26:1789.178.39.143Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
11-08-09 23:24:38174.123.206.82Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50
25-07-09 17:20:4789.210.215.164Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 4.0)
25-07-09 00:18:22149.160.30.86Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
20-07-09 14:46:11174.133.177.66Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50
16-07-09 05:33:4841.210.252.11Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
15-07-09 03:54:0189.248.99.82Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts-MyWay; (R1 1.3); .NET CLR 1.1.4322)
14-07-09 20:08:26174.123.235.130Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
12-07-09 16:12:26208.64.71.123Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-07-09 00:52:23174.129.179.2Test Spider 0.2
09-07-09 20:55:4289.178.38.192Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
04-07-09 15:20:1394.23.121.36Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
01-07-09 01:32:24212.103.139.75Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-06-09 22:03:28174.129.170.144Test Spider 0.2
28-06-09 18:23:35121.9.221.188Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
27-06-09 06:48:45221.194.132.187Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)/Nutch-1.0
26-06-09 04:02:31211.90.137.93Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
24-06-09 08:11:26221.194.132.169Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)/Nutch-1.0
23-06-09 09:11:3758.38.118.151Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; .NET CLR 1.1.4322)
22-06-09 17:22:2464.29.148.20Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
21-06-09 22:56:0564.29.148.48Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-06-09 06:05:5970.84.239.90User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
18-06-09 17:46:5088.191.51.48Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-06-09 23:22:0283.233.30.77Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-06-09 04:28:5492.243.20.45Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-06-09 01:19:56219.101.215.195Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
12-06-09 04:32:5672.51.37.147Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)
11-06-09 12:23:3689.149.226.14Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
10-06-09 22:14:35217.221.182.231Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
09-06-09 22:35:3364.15.129.143User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
07-06-09 08:54:38194.8.75.251Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
02-06-09 00:16:28140.239.56.38Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
30-05-09 12:13:42221.130.193.14Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-05-09 01:07:36221.178.181.196Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
26-05-09 22:27:20211.75.91.19Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-05-09 19:13:00212.117.188.207Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-05-09 05:31:5186.110.225.131Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
15-05-09 23:39:2069.84.207.62Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30)
15-05-09 21:55:27121.52.148.30Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
15-05-09 00:20:01152.78.189.76Java/1.5.0_14
14-05-09 07:07:07213.163.65.73Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-05-09 06:55:3588.84.135.9Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-05-09 23:32:54207.178.14.77Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-05-09 03:45:0061.49.7.135Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-05-09 00:49:5985.211.96.3Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-05-09 23:48:32210.75.23.85Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-05-09 18:56:0464.56.64.57us_viewer larbin2.6.3@unspecified.mail
10-05-09 10:47:45203.180.79.64Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
09-05-09 08:20:21123.202.178.98Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
08-05-09 01:40:20208.74.174.142Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-04-09 22:46:0684.45.46.50Mozilla/5.0 (X11; U; GNU/kFreeBSD i686; en-US; rv:1.8.1.16) Gecko/20080702 Iceape/1.1.11 (Debian-1.1.11-1)
25-04-09 12:08:5593.174.93.223Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt)
21-04-09 13:55:43213.239.200.199Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
18-04-09 04:32:20121.110.80.168Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-04-09 08:16:52192.36.81.250Jakarta Commons-HttpClient/3.1
12-04-09 01:07:38213.147.118.46Java/1.6.0_05
01-04-09 06:45:4066.150.224.245Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)
28-03-09 18:40:2582.213.5.34Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
23-03-09 10:54:17203.110.240.22Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
16-03-09 16:48:5394.229.65.173Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.3) Gecko/20040910
12-03-09 07:00:5387.16.2.116Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
12-03-09 06:55:37201.37.38.177Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-03-09 08:43:12218.248.31.212Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-03-09 05:23:3769.56.251.139
10-03-09 20:12:1089.149.208.29Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
04-03-09 23:37:18120.28.64.69Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
02-03-09 09:30:3474.52.45.250Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50
01-03-09 08:36:34206.51.230.20Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-02-09 02:10:2692.48.201.39Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
23-02-09 11:30:1272.36.115.86CazoodleBot/0.0.2 (http://www.cazoodle.com/contact.php; cbot@cazoodle.com)
23-02-09 09:07:0867.228.207.202Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50
16-02-09 02:21:53203.23.223.174Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
15-02-09 23:13:2993.190.140.63User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
11-02-09 18:58:5987.2.191.202Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
10-02-09 08:14:0087.248.176.150Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-US) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10
09-02-09 13:18:2686.132.211.238Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
06-02-09 10:07:1278.46.87.197Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
02-02-09 17:35:2512.47.77.47Java/1.6.0_10
02-02-09 17:02:4278.159.112.96Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
27-01-09 15:53:0586.15.171.233Wombat UK
25-01-09 11:08:01151.67.219.120Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
25-01-09 10:58:2578.51.118.188Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
22-01-09 08:55:1187.118.110.189Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
20-01-09 11:36:2989.175.191.157Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
20-01-09 03:47:4494.229.65.171Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
18-01-09 03:42:57217.114.210.189Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
18-01-09 02:32:1082.141.247.138Java/1.6.0_11
16-01-09 02:14:5178.26.179.68Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-01-09 11:08:47212.234.105.99Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-01-09 11:07:3485.91.64.219Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-01-09 11:07:32146.101.147.140Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-01-09 21:47:1162.90.102.148Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
06-01-09 14:54:20206.51.230.66Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
05-01-09 19:30:5998.129.136.177Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)
31-12-08 04:05:1459.39.177.236Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
27-12-08 23:40:10206.163.123.217Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.0.1) Gecko/20060124 Firefox/1.5.0.1
27-12-08 22:04:41206.51.230.67Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
17-12-08 18:48:4981.32.253.92Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
17-12-08 05:04:0392.48.194.14Opera/9.01 (Windows NT 5.1; U; en-US)
07-12-08 08:38:09206.161.120.9Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.11;MEGAUPLOAD 1.0
05-12-08 11:36:3074.55.157.242Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
04-12-08 22:40:52217.147.30.110Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
02-12-08 23:35:34192.114.71.13Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
01-12-08 17:11:1941.224.194.198Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
24-11-08 22:42:2694.102.60.183Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
24-11-08 07:22:2583.18.148.142curl/7.16.3 (amd64-portbld-freebsd6.3) libcurl/7.16.3 OpenSSL/0.9.7e zlib/1.2.3
24-11-08 07:21:5783.12.228.78lwp-request/2.07
23-11-08 10:11:0594.102.60.182Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
20-11-08 10:56:2838.105.83.12Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)
14-11-08 05:09:4586.88.202.3Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET)
10-11-08 05:05:4094.76.199.10Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.0) Gecko/20020615 Debian/1.0.0-3
07-11-08 06:48:31200.115.173.44Java/1.6.0_07
03-11-08 07:46:5666.90.118.101Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)
26-10-08 06:16:5787.157.137.45Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET)
24-10-08 06:16:50194.165.42.59Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
22-10-08 11:35:3281.58.42.60A .NET Web Crawler
11-10-08 15:51:1889.223.24.65Java/1.6.0_04
10-10-08 07:54:0989.149.244.45Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
10-10-08 05:30:5082.80.249.145Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
09-10-08 19:07:5669.84.207.147Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30)
06-10-08 10:25:2182.5.116.136Mozilla/3.0 (compatible; Indy Library)
28-09-08 21:03:0867.19.168.162Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)
21-09-08 10:57:1560.240.249.197Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4
05-09-08 11:16:5593.174.93.220Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.1) Gecko/20020827
01-09-08 12:36:0567.19.30.226User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
29-08-08 05:07:39213.149.247.102User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
26-08-08 23:17:4484.33.1.147User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
22-08-08 09:23:5993.174.93.224Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
16-08-08 01:08:12200.115.173.126User-Agent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1
15-08-08 11:07:0292.48.84.209Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
14-08-08 03:24:0093.189.56.218Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
11-08-08 10:00:4866.36.230.78Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)
09-08-08 23:36:5482.80.249.147Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
02-08-08 03:56:0574.86.176.75Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
24-07-08 06:15:06194.83.173.62Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)
22-07-08 12:58:0075.146.183.209Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
15-07-08 23:54:3778.157.143.186Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
12-07-08 08:34:1038.105.83.10Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)
12-07-08 07:33:46123.117.84.56Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9
06-07-08 12:58:4789.240.101.95Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
05-07-08 03:14:2378.151.90.178Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
04-07-08 13:51:4069.84.207.39Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30)
03-07-08 20:00:0767.228.177.87Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/)
03-07-08 05:23:3372.232.56.82Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
21-06-08 14:21:4466.232.126.66Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Hotbar 4.3.1.0)
21-06-08 01:25:2160.190.240.73Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
16-06-08 17:42:3865.222.217.212Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 )
15-06-08 08:42:3488.156.40.97Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
14-06-08 15:57:14217.216.57.40Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
11-06-08 05:01:3138.100.41.113Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)
02-06-08 13:01:4789.149.242.226Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
28-05-08 16:37:20208.99.195.54Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)
25-05-08 05:02:5582.80.249.141Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
20-05-08 00:42:3474.6.20.179Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
10-05-08 15:43:3265.55.210.148msnbot/1.1 (+http://search.msn.com/msnbot.htm)
08-05-08 15:16:5579.144.72.4Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)
28-04-08 05:56:4781.36.163.42Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
28-04-08 03:50:23121.254.121.72Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
27-04-08 04:44:2391.121.118.189Java/1.6.0_05
18-04-08 04:35:1764.62.142.170Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
11-04-08 23:37:0082.80.249.191Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
10-04-08 04:04:30123.117.79.242Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9
25-03-08 12:44:4374.86.171.82Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt)
18-03-08 21:02:4872.18.150.8libwww-perl/5.805
17-03-08 23:23:0267.228.100.140ShablastBot 1.0
10-03-08 21:54:4672.29.233.186dragonfly(ebingbong#playstarmusic.com)
05-03-08 03:13:0366.249.65.76Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
26-02-08 18:40:5064.27.11.179Mozilla/5.0 (X29; U; Linux i986; ru; rv:9.8.1) Gecko/70061023 SUSE/7.0-70 Firefox/9.0
24-02-08 14:36:2472.18.150.6libwww-perl/5.805
07-02-08 21:12:1764.92.172.107Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
06-02-08 00:01:51129.97.128.84Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
05-02-08 12:51:2283.138.130.239Test Spider 0.2
01-02-08 12:11:49209.59.164.82Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322)
01-02-08 11:10:2988.23.107.139Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
31-01-08 03:53:1072.18.152.6libwww-perl/5.805
24-01-08 04:06:5778.156.67.55
16-01-08 17:45:4585.182.25.250MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)
28-12-07 01:02:5687.9.13.231MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)
24-12-07 08:51:5366.249.72.148Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
16-12-07 16:08:1787.122.78.181MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)
09-12-07 08:18:3069.84.207.35Mozilla/4.0 (compatible; MSIE 7.0;Windows NT 5.1;.NET CLR 1.1.4322;.NET CLR 2.0.50727;.NET CLR 3.0.04506.30)
04-12-07 20:35:00129.187.148.244wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)
03-12-07 15:01:3866.249.72.177Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
02-12-07 09:26:48217.93.219.72MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+)
22-11-07 18:03:4882.80.249.142Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
19-11-07 18:27:3989.31.8.146Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
14-11-07 20:24:1666.249.72.103Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
12-11-07 18:47:27218.18.207.32
06-11-07 23:24:2965.55.212.164msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
04-11-07 19:05:1764.92.199.44libwww-perl/5.805
26-10-07 13:50:5982.152.69.117Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
24-10-07 23:59:1464.71.164.125Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://corp.krugle.com/crawler/info.html; webcrawler@krugle.com)
19-10-07 04:19:1782.99.30.36Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
11-10-07 19:42:4670.85.114.130Mozilla/5.0 (compatible; IDBot/1.0; +http://www.id-search.org/bot.html)
10-10-07 09:25:4876.209.55.241Python-urllib/2.4
06-10-07 19:46:5682.99.30.7Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
05-10-07 05:41:0682.99.30.8Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
02-10-07 10:11:4882.99.30.32Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
29-09-07 22:42:0465.55.212.162msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
26-09-07 19:51:00129.187.148.240wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)
08-09-07 18:27:53207.46.55.31MSNPTC/1.0
06-09-07 15:39:4566.249.72.231Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
01-09-07 01:27:2076.209.56.179Python-urllib/2.4
27-08-07 23:05:47209.85.114.31
24-08-07 11:35:1160.12.226.251Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)
06-08-07 00:54:15195.248.98.191Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727)
03-08-07 16:21:4986.14.75.232Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; Mozilla/4.0(Compatible Mozilla/4.0(Compatible-EmbeddedWB 14.57 http://bsalsa.com/ EmbeddedWB- 14.57 from: http://bsalsa.com/ ; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506; .NET CLR 1.1.4322)
01-08-07 03:24:0664.92.199.39libwww-perl/5.805
20-07-07 03:24:4382.80.249.156Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
13-07-07 09:21:0538.100.41.105Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
09-07-07 05:44:3965.55.209.144msnbot/1.0 (+http://search.msn.com/msnbot.htm)
04-07-07 08:52:5966.249.72.72Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
27-06-07 14:00:1384.201.160.74Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Q312461; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
21-06-07 13:39:55209.62.20.18Mozilla/5.0 (compatible; heritrix/1.12.1 +http://newtestbabes.com)
15-06-07 09:03:3589.149.194.28
13-06-07 19:33:4838.100.41.102Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
11-06-07 05:37:0074.6.27.24Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
08-06-07 17:57:4166.249.66.137Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
06-06-07 03:04:1366.90.101.75Mozilla/5.0 (compatible; IDBot/1.0; +http://www.id-search.org/bot.html)
03-06-07 13:19:21207.46.98.78msnbot/1.0 (+http://search.msn.com/msnbot.htm)
27-05-07 17:18:4965.55.212.163msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
27-05-07 07:39:23217.168.144.228Mozilla/3.0 (compatible)
27-05-07 04:31:26129.187.148.163wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)
24-05-07 06:01:36218.13.50.94Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
23-05-07 00:57:58208.108.220.220Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
21-05-07 06:21:18211.117.87.226Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
19-05-07 07:53:0765.55.209.143msnbot/1.0 (+http://search.msn.com/msnbot.htm)
17-05-07 18:23:06159.226.26.99Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322)
16-05-07 01:42:01220.72.219.218Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
13-05-07 16:15:4669.50.170.179User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
11-05-07 23:54:29207.46.98.82msnbot/1.0 (+http://search.msn.com/msnbot.htm)
29-04-07 13:08:0066.249.65.47Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
28-04-07 21:57:4665.55.209.150msnbot/1.0 (+http://search.msn.com/msnbot.htm)
14-04-07 20:02:4965.55.209.151msnbot/1.0 (+http://search.msn.com/msnbot.htm)
13-04-07 18:13:0438.100.41.112Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
01-04-07 11:03:1688.152.36.94
14-03-07 08:01:3438.100.41.107Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
27-02-07 20:37:1884.88.32.202Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) Opera 7.23 [ca]
25-02-07 18:11:1282.80.249.155Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; (R1 1.1); .NET CLR 1.1.4322)
13-02-07 04:02:4565.222.176.122Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
14-01-07 05:43:2080.229.157.13Test Spider 0.1
26-12-06 21:55:1786.142.83.119Mozilla/4.0+(compatible;+MSIE+7.0;+Windows+NT+5.2;+WOW64;+.NET+CLR+2.0.50727;+InfoPath.1)
27-11-06 09:48:3680.3.160.13Mozilla/4.0 (compatible ; MSIE 6.0; Windows NT 5.1)
18-11-06 10:38:3074.6.69.206Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
15-11-06 12:40:0965.222.176.125Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
03-11-06 13:14:1182.153.252.57Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; phpSitemapNG 1.5.2)
18-10-06 10:39:52212.227.102.33192.comAgent
10-10-06 05:32:2565.222.176.124Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
28-09-06 03:04:0882.153.93.8Java/1.4.1_04
26-09-06 04:51:1624.92.180.146
23-09-06 09:18:42208.66.194.169Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
18-09-06 23:03:3870.85.85.132
18-09-06 23:03:30203.113.13.3
16-09-06 05:49:25193.47.80.39Exabot/3.0
13-09-06 17:19:0166.36.243.202User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
11-09-06 23:46:5063.148.99.237Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
05-09-06 08:28:15129.187.148.161wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de)
02-09-06 04:29:00208.66.195.4Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322)
19-08-06 23:02:0963.100.163.59Mozilla/4.0 (compatible; MSIE 6.0; Windows XP)
16-08-06 15:19:0664.233.172.17Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; InfoPath.1)
15-08-06 10:44:0864.92.201.114Mozilla/4.0 compatible