Choose a log file:
Here is a list of search engine crawlers from Google, Yahoo, MSN and Ask which requested it.
This is a list of other user agents which requested it, but weren't verified as crawlers from major search engines.
/repstuff/robots.txt is just an example I've used in this post on cloaking robots.txt files. Of course search engines expect to find your robots.txt on root level.
Here is the log file:
| IP Address | TimeStamp | Response | UserAgent | Requested URI |
| Faked | 2007-11-26 00:00:01 | 200-OK | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | /repstuff/robots.txt |
| Faked | 2007-11-26 00:00:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/robots.txt |
| Faked | 2007-11-26 00:00:01 | 200-OK | Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) | /repstuff/robots.txt |
| Faked | 2007-11-26 00:00:01 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| Faked | 2007-11-26 00:00:01 | 200-OK | Googlebot/2.1 (+http://www.google.com/bot.html) | /repstuff/robots.txt |
| 216.24.131.152 | 2007-11-26 11:03:12 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName= |
| 216.24.131.152 | 2007-11-26 11:04:20 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 216.24.131.152 | 2007-11-26 11:04:24 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 216.24.131.152 | 2007-11-26 11:05:06 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Teoma |
| 216.24.131.152 | 2007-11-26 11:05:17 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt |
| 216.24.131.152 | 2007-11-26 11:05:54 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=msnbot |
| 216.24.131.152 | 2007-11-26 11:05:59 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 216.24.131.152 | 2007-11-26 11:06:02 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot |
| 216.24.131.152 | 2007-11-26 11:08:37 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 216.24.131.152 | 2007-11-26 11:08:40 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Slurp |
| 203.150.103.180 | 2007-11-26 11:38:46 | 200-OK | Java/1.6.0 | /repstuff/robots.txt |
| 137.201.242.130 | 2007-11-26 12:00:33 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot |
| 137.201.242.130 | 2007-11-26 12:00:38 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 137.201.242.130 | 2007-11-26 12:00:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=* |
| 75.168.122.92 | 2007-11-26 12:48:45 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt |
| 75.168.122.92 | 2007-11-26 12:49:11 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 24.153.228.2 | 2007-11-26 14:15:31 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 24.153.228.2 | 2007-11-26 14:15:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot |
| 144.131.143.110 | 2007-11-26 14:18:13 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 144.131.143.110 | 2007-11-26 14:18:35 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.202.25.186 | 2007-11-26 14:39:22 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt |
| 67.202.25.186 | 2007-11-26 14:39:22 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.202.25.186 | 2007-11-26 14:39:22 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.202.25.186 | 2007-11-26 14:39:22 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.202.25.186 | 2007-11-26 14:39:22 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.202.25.186 | 2007-11-26 14:39:23 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.202.25.186 | 2007-11-26 14:39:26 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=msnbot |
| 67.202.25.186 | 2007-11-26 14:39:26 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=Teoma |
| 67.202.25.186 | 2007-11-26 14:39:26 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt?crawlerName=* |
| 67.202.25.186 | 2007-11-26 14:39:38 | 200-OK | PECL::HTTP/1.5.6 (PHP/5.2.4) | /repstuff/robots.txt |
| 209.237.110.62 | 2007-11-26 16:43:12 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10 | /repstuff/robots.txt |
| 209.237.110.62 | 2007-11-26 16:43:34 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 66.244.109.158 | 2007-11-26 18:10:53 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=* |
| 24.92.172.207 | 2007-11-26 18:17:50 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 24.92.172.207 | 2007-11-26 18:17:58 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 189.11.91.186 | 2007-11-26 19:03:08 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 189.11.91.186 | 2007-11-26 19:04:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Googlebot |
| 189.11.91.186 | 2007-11-26 19:06:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Slurp |
| 222.155.12.21 | 2007-11-27 00:47:48 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 222.155.12.21 | 2007-11-27 00:48:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 222.155.12.21 | 2007-11-27 00:49:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 195.112.9.140 | 2007-11-27 01:14:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 195.112.9.140 | 2007-11-27 01:14:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 61.17.161.2 | 2007-11-27 02:03:20 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 61.17.161.2 | 2007-11-27 02:03:38 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=* |
| 86.107.220.199 | 2007-11-27 03:37:48 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-us) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10 | /repstuff/robots.txt |
| 89.132.15.238 | 2007-11-27 04:01:35 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; hu; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 89.132.15.238 | 2007-11-27 04:01:52 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; hu; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 217.126.10.242 | 2007-11-27 05:22:27 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; es-ES; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 217.126.10.242 | 2007-11-27 05:22:28 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; es-ES; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 213.86.234.212 | 2007-11-27 06:06:07 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 68.191.201.2 | 2007-11-27 06:08:33 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 216.124.224.103 | 2007-11-27 07:30:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 216.124.224.103 | 2007-11-27 07:31:00 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Slurp |
| 76.10.131.15 | 2007-11-27 10:36:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 76.10.131.15 | 2007-11-27 10:36:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=* |
| 216.24.131.152 | 2007-11-27 16:31:50 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName= |
| 216.24.131.152 | 2007-11-27 16:32:26 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 216.24.131.152 | 2007-11-27 16:32:29 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 216.24.131.152 | 2007-11-27 16:32:45 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Teoma |
| 216.24.131.152 | 2007-11-27 16:32:51 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt |
| 216.24.131.152 | 2007-11-27 16:33:16 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=msnbot |
| 216.24.131.152 | 2007-11-27 16:33:20 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 216.24.131.152 | 2007-11-27 16:33:23 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Googlebot |
| 216.24.131.152 | 2007-11-27 16:35:01 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 216.24.131.152 | 2007-11-27 16:35:04 | 200-OK | LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) | /repstuff/robots.txt?crawlerName=Slurp |
| 125.17.226.3 | 2007-11-27 21:35:38 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 125.17.226.3 | 2007-11-27 21:36:30 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 195.91.54.84 | 2007-11-27 21:41:04 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.10) Gecko/20061201 Firefox/2.0.0.10 (Ubuntu-feisty) | /repstuff/robots.txt?crawlerName=* |
| 195.246.196.104 | 2007-11-27 23:38:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 195.246.196.104 | 2007-11-27 23:38:30 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 217.36.214.65 | 2007-11-28 05:38:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 217.36.214.65 | 2007-11-28 05:38:57 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 217.36.214.65 | 2007-11-28 05:38:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 217.36.214.65 | 2007-11-28 05:39:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 217.33.19.162 | 2007-11-28 06:22:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7 | /repstuff/robots.txt |
| 217.33.19.162 | 2007-11-28 06:23:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7 | /repstuff/robots.txt?crawlerName=* |
| 74.210.39.224 | 2007-11-28 09:33:22 | 200-OK | Java/1.4.2_16 | /repstuff/robots.txt |
| 208.223.208.181 | 2007-11-28 09:48:50 | 200-OK | shelob v1.0 | /repstuff/robots.txt |
| 208.223.208.181 | 2007-11-28 09:48:51 | 200-OK | shelob v1.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.223.208.181 | 2007-11-28 09:48:51 | 200-OK | shelob v1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 68.191.201.2 | 2007-11-28 12:30:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 24.241.121.49 | 2007-11-28 13:02:27 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SU 3.005; .NET CLR 1.1.4322) | /repstuff/robots.txt |
| 24.241.121.49 | 2007-11-28 13:03:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SU 3.005; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 213.59.0.114 | 2007-11-28 13:35:19 | 200-OK | /repstuff/robots.txt?crawlerName=Googlebot | |
| 80.56.205.12 | 2007-11-28 16:07:54 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 77.250.204.248 | 2007-11-28 16:10:46 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 62.163.70.57 | 2007-11-28 16:39:02 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 77.160.89.4 | 2007-11-28 18:01:53 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 88.49.252.14 | 2007-11-29 01:32:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 88.49.252.14 | 2007-11-29 01:32:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 88.49.252.14 | 2007-11-29 01:32:32 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 62.163.70.57 | 2007-11-29 02:24:01 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 88.49.252.14 | 2007-11-29 02:31:44 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 88.49.252.14 | 2007-11-29 02:32:02 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 88.49.252.14 | 2007-11-29 02:32:06 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 88.49.252.14 | 2007-11-29 02:32:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 88.49.252.14 | 2007-11-29 02:32:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 88.49.252.14 | 2007-11-29 02:32:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; it; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 62.163.70.57 | 2007-11-29 04:38:02 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 76.25.117.121 | 2007-11-29 05:36:29 | 200-OK | Opera/9.50 (X11; Linux x86_64; U; en) | /repstuff/robots.txt |
| 76.25.117.121 | 2007-11-29 05:36:50 | 200-OK | Opera/9.50 (X11; Linux x86_64; U; en) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 76.25.117.121 | 2007-11-29 05:37:14 | 200-OK | Opera/9.50 (X11; Linux x86_64; U; en) | /repstuff/robots.txt?crawlerName=* |
| 76.25.117.121 | 2007-11-29 05:37:19 | 200-OK | Opera/9.50 (X11; Linux x86_64; U; en) | /repstuff/robots.txt?crawlerName=Teoma |
| 216.117.97.193 | 2007-11-29 05:55:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 216.117.97.193 | 2007-11-29 05:56:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=msnbot |
| 213.59.0.114 | 2007-11-29 08:32:06 | 200-OK | /repstuff/robots.txt?crawlerName=Googlebot | |
| 77.249.24.104 | 2007-11-29 08:40:17 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 82.195.228.143 | 2007-11-29 10:29:26 | 200-OK | Mac-Headlines.com WapConverter | /repstuff/robots.txt |
| 64.208.172.179 | 2007-11-29 11:48:32 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 70.89.25.82 | 2007-11-29 12:18:38 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 70.89.25.82 | 2007-11-29 12:18:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot |
| 70.89.25.82 | 2007-11-29 12:19:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 70.89.25.82 | 2007-11-29 12:19:24 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 70.89.25.82 | 2007-11-29 12:19:39 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 70.89.25.82 | 2007-11-29 12:19:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 70.89.25.82 | 2007-11-29 12:20:10 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Slurp |
| 70.89.25.82 | 2007-11-29 12:20:25 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=msnbot |
| 70.89.25.82 | 2007-11-29 12:20:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Teoma |
| 70.89.25.82 | 2007-11-29 12:20:56 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2007-11-29 13:33:15 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2007-11-29 13:33:20 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.208.172.179 | 2007-11-29 13:33:25 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.208.172.179 | 2007-11-29 13:33:30 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.208.172.179 | 2007-11-29 13:33:35 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 64.208.172.179 | 2007-11-29 13:33:40 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 64.208.172.179 | 2007-11-29 13:33:46 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Slurp |
| 64.208.172.179 | 2007-11-29 13:33:51 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Teoma |
| 64.208.172.179 | 2007-11-29 13:34:02 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=msnbot |
| 70.89.25.82 | 2007-11-29 13:42:24 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 70.89.25.82 | 2007-11-29 13:42:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot |
| 70.89.25.82 | 2007-11-29 13:42:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 70.89.25.82 | 2007-11-29 13:43:10 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 70.89.25.82 | 2007-11-29 13:43:28 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 70.89.25.82 | 2007-11-29 13:43:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 70.89.25.82 | 2007-11-29 13:43:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Slurp |
| 70.89.25.82 | 2007-11-29 13:44:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=msnbot |
| 70.89.25.82 | 2007-11-29 13:44:30 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Teoma |
| 70.89.25.82 | 2007-11-29 13:44:45 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 63.149.229.67 | 2007-11-29 14:33:02 | 200-OK | Java/1.5.0_07 | /repstuff/robots.txt |
| 77.248.76.238 | 2007-11-29 16:36:58 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 87.210.72.113 | 2007-11-29 17:57:26 | 200-OK | Java/1.5.0_04 | /repstuff/robots.txt |
| 81.38.71.179 | 2007-11-29 18:50:34 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 62.163.57.150 | 2007-11-29 19:16:09 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 62.163.57.150 | 2007-11-29 19:23:44 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 74.139.95.198 | 2007-11-29 20:08:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 74.139.95.198 | 2007-11-29 20:08:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 74.212.62.240 | 2007-11-29 20:08:30 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506) | /repstuff/robots.txt |
| 74.139.95.198 | 2007-11-29 20:09:06 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 74.139.95.198 | 2007-11-29 20:09:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 74.139.95.198 | 2007-11-29 20:09:20 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 74.139.95.198 | 2007-11-29 20:09:33 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 88.86.197.14 | 2007-11-29 22:41:37 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 88.86.197.14 | 2007-11-29 22:42:21 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 88.86.197.14 | 2007-11-29 22:42:31 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Googlebot |
| 87.210.22.16 | 2007-11-29 22:54:43 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 87.210.40.28 | 2007-11-30 00:53:39 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 89.181.80.186 | 2007-11-30 02:10:19 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 213.59.0.114 | 2007-11-30 03:09:47 | 200-OK | /repstuff/robots.txt?crawlerName=Googlebot | |
| 87.8.156.140 | 2007-11-30 04:23:02 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 77.249.212.211 | 2007-11-30 10:14:33 | 200-OK | Java/1.5.0_06 | /repstuff/robots.txt |
| 193.109.164.178 | 2007-11-30 14:41:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.10) Gecko/20071115 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 72.197.80.184 | 2007-11-30 21:03:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 72.197.80.184 | 2007-11-30 21:04:04 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.208.172.179 | 2007-12-01 05:08:56 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 64.208.172.179 | 2007-12-01 05:26:48 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 71.195.237.42 | 2007-12-02 14:46:12 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 71.195.237.42 | 2007-12-02 14:46:23 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 213.46.87.247 | 2007-12-02 19:23:07 | 200-OK | Java/1.6.0-oem | /repstuff/robots.txt |
| 64.208.172.179 | 2007-12-04 09:21:19 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 75.140.128.210 | 2007-12-04 10:27:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 75.140.128.210 | 2007-12-04 10:27:24 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=msnbot |
| 75.140.128.210 | 2007-12-04 10:27:30 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 213.154.48.81 | 2007-12-04 10:46:11 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 76.169.216.171 | 2007-12-04 17:16:03 | 200-OK | Opera/9.24 (Windows NT 5.1; U; en) | /repstuff/robots.txt |
| 76.169.216.171 | 2007-12-04 17:16:17 | 200-OK | Opera/9.24 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Slurp |
| 82.0.175.0 | 2007-12-06 10:08:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 82.0.175.0 | 2007-12-06 10:08:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.54.165.64 | 2007-12-06 19:54:45 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.54.165.64 | 2007-12-06 20:19:44 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 116.71.47.160 | 2007-12-06 22:22:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; Avant Browser; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 74.86.171.82 | 2007-12-07 14:20:03 | 200-OK | Mozilla/5.0 (Windows NT 5.1; U) Opera 7.54 [ru] | /repstuff/robots.txt |
| 74.86.171.82 | 2007-12-07 14:20:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; http://www.tropicdesigns.net) | /repstuff/robots.txt?crawlerName=Googlebot |
| 74.86.171.82 | 2007-12-07 14:20:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 74.86.171.82 | 2007-12-07 14:20:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MRA 4.1 (build 00975)) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 74.86.171.82 | 2007-12-07 14:20:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 74.86.171.82 | 2007-12-07 14:20:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 5.0; Windows 98) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 74.86.171.82 | 2007-12-07 14:20:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; MyIE2; MRA 4.4 (build 01348)) | /repstuff/robots.txt?crawlerName=Slurp |
| 74.86.171.82 | 2007-12-07 14:20:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=msnbot |
| 74.86.171.82 | 2007-12-07 14:20:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 5.0; Windows 98) | /repstuff/robots.txt?crawlerName=Teoma |
| 74.86.171.82 | 2007-12-07 14:20:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 65.55.234.164 | 2007-12-07 19:43:06 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.234.164 | 2007-12-07 19:43:25 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.234.164 | 2007-12-07 19:43:26 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 65.55.234.164 | 2007-12-07 19:43:26 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.234.164 | 2007-12-07 19:43:26 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 68.37.34.3 | 2007-12-09 05:36:13 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=msnbot |
| 71.228.115.118 | 2007-12-09 10:11:27 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 71.228.115.118 | 2007-12-09 10:11:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 71.228.115.118 | 2007-12-09 10:12:00 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Slurp |
| 99.237.237.39 | 2007-12-09 10:57:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 207.70.164.189 | 2007-12-10 02:44:05 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 216.21.142.9 | 2007-12-10 13:32:32 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 123.4.39.245 | 2007-12-10 21:51:32 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt |
| 123.4.39.245 | 2007-12-10 21:51:33 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 123.4.39.245 | 2007-12-10 21:51:33 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 123.4.39.245 | 2007-12-10 21:51:33 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 123.4.39.245 | 2007-12-10 21:51:33 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=msnbot |
| 123.4.39.245 | 2007-12-10 21:51:34 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.68.55.186 | 2007-12-11 06:36:37 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 82.241.215.62 | 2007-12-11 08:32:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt |
| 82.241.215.62 | 2007-12-11 08:32:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Googlebot |
| 82.241.215.62 | 2007-12-11 08:32:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 82.241.215.62 | 2007-12-11 08:32:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 82.241.215.62 | 2007-12-11 08:32:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 82.241.215.62 | 2007-12-11 08:32:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 82.241.215.62 | 2007-12-11 08:32:18 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Slurp |
| 82.241.215.62 | 2007-12-11 08:32:18 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=msnbot |
| 82.241.215.62 | 2007-12-11 08:32:19 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=Teoma |
| 82.241.215.62 | 2007-12-11 08:32:19 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8) Gecko/20051111 Firefox/1.5 | /repstuff/robots.txt?crawlerName=* |
| 203.115.71.10 | 2007-12-11 22:52:02 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 203.115.71.10 | 2007-12-11 22:52:13 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 203.115.71.10 | 2007-12-11 22:52:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Teoma |
| 131.123.252.100 | 2007-12-12 00:30:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt |
| 131.123.252.100 | 2007-12-12 00:31:04 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.9) Gecko/20071025 Firefox/2.0.0.9 | /repstuff/robots.txt?crawlerName=Googlebot |
| 69.20.237.2 | 2007-12-12 06:41:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot) | /repstuff/robots.txt |
| 121.246.0.102 | 2007-12-13 08:25:57 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b1) Gecko/2007110903 Firefox/3.0b1 | /repstuff/robots.txt |
| 218.47.225.171 | 2007-12-13 22:11:26 | 200-OK | /repstuff/robots.txt?crawlername=msnbot | |
| 91.84.125.51 | 2007-12-14 14:44:24 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 91.84.125.51 | 2007-12-14 14:45:03 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 91.84.125.51 | 2007-12-14 14:46:37 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 91.84.125.51 | 2007-12-14 14:48:28 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 91.84.125.51 | 2007-12-14 14:49:48 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 221.218.0.158 | 2007-12-16 05:10:57 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Slurp |
| 71.63.133.22 | 2007-12-16 08:17:39 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel McG OS X; en-us) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10 | /repstuff/robots.txt |
| 71.63.133.22 | 2007-12-16 08:17:56 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel McG OS X; en-us) AppleWebKit/523.10.3 (KHTML, like Gecko) Version/3.0.4 Safari/523.10 | /repstuff/robots.txt?crawlerName=Teoma |
| 81.156.176.183 | 2007-12-16 21:18:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 81.156.176.183 | 2007-12-16 21:18:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 80.141.60.204 | 2007-12-17 07:49:16 | 200-OK | Mozilla/5.0 (Windows NT 5.1; en-US; rv:1.7.10) Gecko/20050717 Firefox/1.0.6 | /repstuff/robots.txt |
| 62.128.56.4 | 2007-12-18 04:31:26 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 62.128.56.4 | 2007-12-18 04:31:30 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 218.18.125.199 | 2007-12-19 02:29:54 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Teoma |
| 71.42.178.82 | 2007-12-19 07:46:13 | 200-OK | Java/1.6.0_02 | /repstuff/robots.txt |
| 124.188.117.92 | 2007-12-19 21:45:11 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/522.11.1 (KHTML, like Gecko) Version/3.0.3 Safari/522.12.1 | /repstuff/robots.txt |
| 124.188.117.92 | 2007-12-19 21:45:13 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/522.11.1 (KHTML, like Gecko) Version/3.0.3 Safari/522.12.1 | /repstuff/robots.txt?crawlerName=Googlebot |
| 124.188.117.92 | 2007-12-19 21:46:08 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/522.11.1 (KHTML, like Gecko) Version/3.0.3 Safari/522.12.1 | /repstuff/robots.txt?crawlerName=* |
| 63.82.71.139 | 2007-12-20 02:12:00 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt |
| 63.82.71.139 | 2007-12-20 02:28:11 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Googlebot |
| 63.82.71.139 | 2007-12-20 02:42:14 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 63.82.71.139 | 2007-12-20 02:51:43 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Slurp |
| 63.82.71.139 | 2007-12-20 02:54:31 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 63.82.71.139 | 2007-12-20 02:56:50 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=* |
| 63.82.71.139 | 2007-12-20 03:07:57 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 63.82.71.139 | 2007-12-20 03:15:49 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Teoma |
| 63.82.71.139 | 2007-12-20 03:16:37 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 63.82.71.139 | 2007-12-20 03:17:31 | 200-OK | my-heritrix-crawler(+http://mywebsite.com) | /repstuff/robots.txt?crawlerName=msnbot |
| 212.202.176.75 | 2007-12-20 15:17:22 | 200-OK | Java/1.4.2_03 | /repstuff/robots.txt |
| 72.36.115.42 | 2007-12-21 03:14:07 | 200-OK | CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) | /repstuff/robots.txt |
| 68.191.201.2 | 2007-12-21 16:29:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 207.67.117.170 | 2007-12-21 18:57:20 | 200-OK | larbin_2.6.3 larbin2.6.3@unspecified.mail | /repstuff/robots.txt |
| 207.67.117.178 | 2007-12-21 20:32:23 | 200-OK | larbin_2.6.3 larbin2.6.3@unspecified.mail | /repstuff/robots.txt |
| 60.236.250.120 | 2007-12-24 09:38:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot |
| 60.236.250.120 | 2007-12-24 09:38:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) | /repstuff/robots.txt |
| 91.15.117.253 | 2007-12-24 13:37:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 91.15.117.253 | 2007-12-24 13:37:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 71.42.178.82 | 2007-12-24 19:34:34 | 200-OK | Java/1.6.0_02 | /repstuff/robots.txt |
| 61.100.193.243 | 2007-12-25 06:36:37 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 72.14.195.225 | 2007-12-25 14:59:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 72.14.195.225 | 2007-12-25 15:00:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 86.92.140.19 | 2007-12-25 17:22:12 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 125.45.113.165 | 2007-12-25 22:42:27 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Teoma |
| 67.78.34.166 | 2007-12-27 04:23:30 | 200-OK | VadixBot | /repstuff/robots.txt?crawlerName=Slurp |
| 78.94.48.114 | 2007-12-27 14:09:18 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 78.94.48.114 | 2007-12-27 14:14:19 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 78.94.48.114 | 2007-12-27 14:16:33 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 78.94.48.114 | 2007-12-27 14:19:00 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 78.94.48.114 | 2007-12-27 14:20:59 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.71.68.125 | 2007-12-28 09:46:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt |
| 67.71.68.125 | 2007-12-28 09:46:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.71.68.125 | 2007-12-28 09:46:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.71.68.125 | 2007-12-28 09:46:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.71.68.125 | 2007-12-28 09:46:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.71.68.125 | 2007-12-28 09:46:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.71.68.125 | 2007-12-28 09:46:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Slurp |
| 67.71.68.125 | 2007-12-28 09:46:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=msnbot |
| 67.71.68.125 | 2007-12-28 09:46:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Teoma |
| 67.71.68.125 | 2007-12-28 09:46:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=* |
| 67.68.56.247 | 2007-12-29 12:22:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt |
| 67.68.56.247 | 2007-12-29 12:22:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.68.56.247 | 2007-12-29 12:22:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.68.56.247 | 2007-12-29 12:22:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.68.56.247 | 2007-12-29 12:22:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.68.56.247 | 2007-12-29 12:22:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.68.56.247 | 2007-12-29 12:22:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Slurp |
| 67.68.56.247 | 2007-12-29 12:22:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=msnbot |
| 67.68.56.247 | 2007-12-29 12:22:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Teoma |
| 67.68.56.247 | 2007-12-29 12:22:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2007-12-29 14:23:58 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 64.208.172.179 | 2007-12-29 14:25:36 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 64.208.172.179 | 2007-12-30 03:23:40 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2007-12-30 03:23:45 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.208.172.179 | 2007-12-30 03:23:50 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.208.172.179 | 2007-12-30 03:23:55 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.208.172.179 | 2007-12-30 03:24:00 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 64.208.172.179 | 2007-12-30 03:24:05 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 64.208.172.179 | 2007-12-30 03:24:10 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Slurp |
| 64.208.172.179 | 2007-12-30 03:24:18 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Teoma |
| 64.208.172.179 | 2007-12-30 03:24:23 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=msnbot |
| 208.65.90.96 | 2007-12-31 16:22:40 | 200-OK | Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.10) Gecko/20071208 Firefox/2.0.0.10 | /repstuff/robots.txt |
| 208.65.90.96 | 2007-12-31 16:23:18 | 200-OK | Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.10) Gecko/20071208 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=* |
| 208.65.90.96 | 2007-12-31 20:51:02 | 200-OK | Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.10) Gecko/20071208 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=Slurp |
| 208.65.90.96 | 2007-12-31 20:51:20 | 200-OK | Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.10) Gecko/20071208 Firefox/2.0.0.10 | /repstuff/robots.txt?crawlerName=msnbot |
| 125.45.113.86 | 2008-01-02 02:03:13 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 216.105.135.18 | 2008-01-02 07:07:35 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 216.105.135.18 | 2008-01-02 07:07:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 216.105.135.18 | 2008-01-02 07:08:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 24.22.218.77 | 2008-01-02 18:58:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.3); .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 24.22.218.77 | 2008-01-02 18:58:23 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; (R1 1.3); .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 136.159.185.16 | 2008-01-03 10:08:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 123.4.37.37 | 2008-01-04 11:29:04 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Googlebot |
| 123.4.37.37 | 2008-01-04 11:29:04 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 88.198.21.111 | 2008-01-04 14:20:13 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=mediapartners-google |
| 88.198.21.111 | 2008-01-04 14:21:02 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=teoma |
| 88.198.21.111 | 2008-01-04 14:21:07 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt |
| 88.198.21.111 | 2008-01-04 14:22:18 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=googlebot-image |
| 88.198.21.111 | 2008-01-04 14:22:29 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=adsbot-google |
| 88.198.21.111 | 2008-01-04 14:25:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=slurp |
| 88.198.21.111 | 2008-01-04 14:26:09 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=googlebot |
| 88.198.21.111 | 2008-01-04 14:26:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=msnbot |
| 88.198.21.111 | 2008-01-04 14:27:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlername=googlebot-mobile |
| 138.232.66.181 | 2008-01-04 14:59:55 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt |
| 138.232.66.181 | 2008-01-04 14:59:55 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 138.232.66.181 | 2008-01-04 14:59:55 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 138.232.66.181 | 2008-01-04 14:59:56 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 138.232.66.181 | 2008-01-04 14:59:56 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 138.232.66.181 | 2008-01-04 14:59:56 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 138.232.66.181 | 2008-01-04 14:59:56 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 138.232.66.181 | 2008-01-04 14:59:57 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=msnbot |
| 138.232.66.181 | 2008-01-04 14:59:57 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName=Teoma |
| 138.232.66.181 | 2008-01-04 14:59:57 | 200-OK | Mozilla/5.0 | /repstuff/robots.txt?crawlerName |
| 82.10.95.145 | 2008-01-05 05:05:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=* |
| 68.8.131.231 | 2008-01-05 10:02:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Teoma |
| 68.8.131.231 | 2008-01-05 10:02:23 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.202.4.131 | 2008-01-05 21:29:34 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.202.4.131 | 2008-01-05 21:29:35 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Slurp |
| 67.202.4.131 | 2008-01-05 21:29:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=msnbot |
| 67.202.4.131 | 2008-01-05 21:29:45 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.202.4.131 | 2008-01-05 21:29:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.202.4.131 | 2008-01-05 21:30:16 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName= |
| 67.202.4.131 | 2008-01-05 21:30:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt |
| 67.202.4.131 | 2008-01-05 21:31:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.202.4.131 | 2008-01-05 21:31:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Teoma |
| 67.202.4.131 | 2008-01-05 21:31:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461) Java/1.5.0_09 | /repstuff/robots.txt?crawlerName=Googlebot |
| 89.83.145.198 | 2008-01-06 04:51:34 | 200-OK | HTTPConnect | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 89.83.145.198 | 2008-01-06 04:51:34 | 200-OK | HTTPConnect | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 24.182.45.28 | 2008-01-06 13:44:13 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 218.186.12.10 | 2008-01-07 05:50:56 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt |
| 218.186.12.10 | 2008-01-07 05:51:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 79.6.5.200 | 2008-01-07 11:53:55 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 79.6.5.200 | 2008-01-07 11:53:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 79.6.5.200 | 2008-01-07 11:53:57 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 79.6.5.200 | 2008-01-07 11:53:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 79.6.5.200 | 2008-01-07 11:54:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 87.210.88.14 | 2008-01-07 14:39:30 | 200-OK | Java/1.6.0_02 | /repstuff/robots.txt |
| 77.179.235.107 | 2008-01-07 16:54:31 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 67.79.179.114 | 2008-01-07 18:10:52 | 200-OK | Java/1.5.0 | /repstuff/robots.txt |
| 62.163.32.151 | 2008-01-07 19:02:17 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 194.169.192.9 | 2008-01-07 19:08:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt |
| 194.169.192.9 | 2008-01-07 19:08:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=googlebot |
| 194.169.192.9 | 2008-01-07 19:08:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=googlebot-mobile |
| 194.169.192.9 | 2008-01-07 19:08:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=googlebot-image |
| 194.169.192.9 | 2008-01-07 19:08:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=mediapartners-google |
| 194.169.192.9 | 2008-01-07 19:08:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=adsbot-google |
| 194.169.192.9 | 2008-01-07 19:08:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=slurp |
| 194.169.192.9 | 2008-01-07 19:08:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=msnbot |
| 194.169.192.9 | 2008-01-07 19:08:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=teoma |
| 194.169.192.9 | 2008-01-07 19:08:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 6.1) | /repstuff/robots.txt?crawlername=* |
| 62.163.70.150 | 2008-01-07 19:51:11 | 200-OK | Java/1.6.0_02 | /repstuff/robots.txt |
| 77.248.76.238 | 2008-01-07 19:54:43 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 70.89.173.58 | 2008-01-08 00:16:44 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 83.13.242.147 | 2008-01-08 02:01:36 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 84.250.165.93 | 2008-01-08 02:49:23 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 84.250.165.93 | 2008-01-08 02:49:36 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 84.250.165.93 | 2008-01-08 02:49:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fi; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 77.248.76.238 | 2008-01-08 11:24:40 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 65.78.19.225 | 2008-01-08 12:11:44 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2 | /repstuff/robots.txt |
| 65.78.19.225 | 2008-01-08 12:11:53 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.78.19.225 | 2008-01-08 12:12:05 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12.2 (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 62.163.15.18 | 2008-01-08 14:14:42 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 77.248.44.230 | 2008-01-08 14:15:59 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 24.132.55.15 | 2008-01-08 17:00:44 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 77.249.9.196 | 2008-01-08 17:12:52 | 200-OK | Java/1.5.0_08 | /repstuff/robots.txt |
| 86.54.129.177 | 2008-01-08 19:50:41 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 24.132.55.15 | 2008-01-09 05:02:41 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 62.163.70.150 | 2008-01-09 07:34:21 | 200-OK | Java/1.6.0_03 | /repstuff/robots.txt |
| 91.121.96.134 | 2008-01-09 11:14:52 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 86.92.140.19 | 2008-01-09 13:10:57 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 122.160.84.4 | 2008-01-10 23:40:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 195.241.98.152 | 2008-01-11 15:09:42 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12 (KHTML, like Gecko) Version/3.0.4 Safari/523.12 | /repstuff/robots.txt?crawlerName=* |
| 195.241.98.152 | 2008-01-11 15:13:07 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12 (KHTML, like Gecko) Version/3.0.4 Safari/523.12 | /repstuff/robots.txt |
| 195.241.98.152 | 2008-01-11 15:13:10 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12 (KHTML, like Gecko) Version/3.0.4 Safari/523.12 | /repstuff/robots.txt?crawlerName=msnbot |
| 195.241.98.152 | 2008-01-11 15:13:28 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en) AppleWebKit/523.12 (KHTML, like Gecko) Version/3.0.4 Safari/523.12 | /repstuff/robots.txt?crawlerName=* |
| 207.67.117.178 | 2008-01-11 17:28:49 | 200-OK | larbin_2.6.3 larbin2.6.3@unspecified.mail | /repstuff/robots.txt |
| 38.99.13.124 | 2008-01-12 03:19:19 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 38.99.13.124 | 2008-01-12 06:08:13 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 38.99.13.124 | 2008-01-13 01:54:00 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 38.99.13.124 | 2008-01-13 05:22:53 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=* |
| 38.99.13.124 | 2008-01-13 05:39:19 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 38.99.13.124 | 2008-01-13 06:59:34 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 218.28.88.101 | 2008-01-13 20:49:29 | 200-OK | Mozilla/3.0 (compatible; Indy Library) | /repstuff/robots.txt?crawlerName=Googlebot |
| 69.16.205.196 | 2008-01-15 05:07:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.nedkellypub.it%2Fconcerti%2Fdati%2Folukev%2Forawo%2F |
| 69.16.205.196 | 2008-01-15 05:07:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 69.16.205.196 | 2008-01-15 05:07:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 189.31.73.176 | 2008-01-15 07:16:23 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 189.31.73.176 | 2008-01-15 07:19:38 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 189.31.73.176 | 2008-01-15 07:23:45 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 189.31.73.176 | 2008-01-15 07:34:20 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 189.31.73.176 | 2008-01-15 07:36:18 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 148.223.200.51 | 2008-01-15 12:37:07 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 148.223.200.51 | 2008-01-15 12:39:08 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 148.223.200.51 | 2008-01-15 12:41:17 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 81.203.140.42 | 2008-01-15 12:50:44 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 148.223.200.51 | 2008-01-15 12:51:26 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 81.203.140.42 | 2008-01-15 12:52:07 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 81.203.140.42 | 2008-01-15 12:53:13 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 81.203.140.42 | 2008-01-15 12:58:52 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 81.203.140.42 | 2008-01-15 13:02:27 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 148.223.200.51 | 2008-01-15 13:02:50 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 200.204.194.218 | 2008-01-16 09:18:18 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 200.204.194.218 | 2008-01-16 09:21:20 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 200.204.194.218 | 2008-01-16 09:27:58 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 200.204.194.218 | 2008-01-16 09:30:21 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 200.204.194.218 | 2008-01-16 09:32:23 | 200-OK | MJ12bot/v1.0.8 (http://majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.54.165.43 | 2008-01-16 21:26:04 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.54.165.42 | 2008-01-16 23:06:14 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.54.165.42 | 2008-01-17 01:30:43 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.54.165.43 | 2008-01-17 04:06:08 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.54.165.43 | 2008-01-17 04:14:58 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.54.165.43 | 2008-01-17 05:12:49 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.54.165.43 | 2008-01-17 05:33:15 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.54.165.43 | 2008-01-17 06:02:54 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.54.165.43 | 2008-01-17 07:16:49 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.54.165.43 | 2008-01-17 08:07:26 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.54.165.43 | 2008-01-17 08:30:03 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 206.80.1.253 | 2008-01-18 02:03:42 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 206.80.1.253 | 2008-01-18 02:05:13 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Googlebot |
| 206.80.1.253 | 2008-01-18 02:06:36 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 206.80.1.253 | 2008-01-18 02:07:04 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt |
| 206.80.1.253 | 2008-01-18 02:08:27 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 206.80.1.253 | 2008-01-18 02:09:47 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=msnbot |
| 206.80.1.253 | 2008-01-18 02:10:43 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Teoma |
| 206.80.1.253 | 2008-01-18 02:11:08 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=* |
| 206.80.1.253 | 2008-01-18 03:01:32 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 206.80.1.253 | 2008-01-18 05:04:13 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=* |
| 206.80.1.253 | 2008-01-18 05:05:16 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/robots.txt?crawlerName=Slurp |
| 41.204.224.21 | 2008-01-19 12:08:38 | 200-OK | WebCopier_for_Mac/4.0 Java/1.5.0_06 | /repstuff/robots.txt |
| 66.177.53.23 | 2008-01-19 12:37:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt |
| 66.177.53.23 | 2008-01-19 12:37:29 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 66.177.53.23 | 2008-01-19 12:37:44 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 | /repstuff/robots.txt?crawlerName=* |
| 68.222.36.192 | 2008-01-20 10:05:35 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 41.224.249.226 | 2008-01-20 12:16:26 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1 | /repstuff/robots.txt?crawlerName=Slurp |
| 41.224.249.226 | 2008-01-20 12:21:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET | /repstuff/robots.txt?crawlerName=Googlebot |
| 41.224.249.226 | 2008-01-20 12:27:23 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET | /repstuff/robots.txt?crawlerName=msnbot |
| 41.224.249.226 | 2008-01-20 12:31:42 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 41.224.249.226 | 2008-01-20 12:34:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 190.189.92.176 | 2008-01-20 19:38:28 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 190.189.92.176 | 2008-01-20 19:40:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 59.106.82.251 | 2008-01-21 11:33:38 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 59.106.82.243 | 2008-01-21 13:06:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.106.82.243 | 2008-01-21 13:08:06 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 59.106.82.243 | 2008-01-21 13:26:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Teoma |
| 59.106.82.243 | 2008-01-21 13:32:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt |
| 59.106.82.251 | 2008-01-21 13:56:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=msnbot |
| 59.106.82.251 | 2008-01-21 13:59:35 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 59.106.82.251 | 2008-01-21 13:59:39 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 59.106.82.251 | 2008-01-21 15:27:54 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 59.106.82.243 | 2008-01-21 15:29:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Slurp |
| 205.196.222.10 | 2008-01-21 18:05:53 | 200-OK | Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal : Mishpat : עורכי דין : חוק ומשפט hybridwse@runnk.com | /repstuff/robots.txt |
| 207.237.100.165 | 2008-01-23 08:35:23 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 207.237.100.165 | 2008-01-23 08:35:36 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 85.112.132.190 | 2008-01-23 08:58:48 | 200-OK | Opera/9.25 (X11; Linux i686; U; en) | /repstuff/robots.txt?crawlerName=* |
| 85.112.132.190 | 2008-01-23 08:59:25 | 200-OK | Opera/9.25 (X11; Linux i686; U; en) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 91.142.3.101 | 2008-01-24 09:34:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt |
| 77.91.224.14 | 2008-01-25 02:12:57 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-01-25 02:13:47 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-01-25 02:15:56 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-01-25 02:15:57 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.14 | 2008-01-25 02:18:02 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.14 | 2008-01-25 02:18:47 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-01-25 02:18:49 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.14 | 2008-01-25 02:20:52 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-01-25 02:21:38 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-01-25 02:23:41 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 201.226.171.43 | 2008-01-25 17:44:22 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 201.226.171.43 | 2008-01-25 17:44:38 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 201.226.171.43 | 2008-01-25 17:44:53 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 72.138.168.55 | 2008-01-26 04:41:38 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 205.196.222.10 | 2008-01-26 17:04:27 | 200-OK | Runnk RSS aggregator : http://www.runnk.com/il/law Israeli legal עורכי דין חוק ומשפט hybridwse@runnk.com | /repstuff/robots.txt |
| 79.166.110.233 | 2008-01-27 10:30:14 | 200-OK | Opera/9.25 (Windows NT 5.2; U; MEGAUPLOAD 2.0; en) | /repstuff/robots.txt |
| 79.166.110.233 | 2008-01-27 10:30:16 | 200-OK | Opera/9.25 (Windows NT 5.2; U; MEGAUPLOAD 2.0; en) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.163.61.130 | 2008-01-28 23:29:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2008-01-29 02:45:03 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 64.208.172.179 | 2008-01-29 02:51:08 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 221.208.241.236 | 2008-01-29 04:36:41 | 200-OK | larbin_2.6.3 larbin2.6.3@unspecified.mail | /repstuff/robots.txt |
| 216.12.101.42 | 2008-01-29 06:42:13 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b2) Gecko/2007121120 Firefox/3.0b2 | /repstuff/robots.txt |
| 68.191.201.2 | 2008-01-29 18:13:05 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 67.129.130.129 | 2008-01-30 04:20:24 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt |
| 67.129.130.129 | 2008-01-30 04:20:25 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.129.130.129 | 2008-01-30 04:20:25 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.129.130.129 | 2008-01-30 04:20:26 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.129.130.129 | 2008-01-30 04:20:26 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.129.130.129 | 2008-01-30 04:20:26 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.129.130.129 | 2008-01-30 04:20:27 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Slurp |
| 67.129.130.129 | 2008-01-30 04:20:30 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=msnbot |
| 67.129.130.129 | 2008-01-30 04:20:33 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=Teoma |
| 67.129.130.129 | 2008-01-30 04:20:34 | 200-OK | Missigua Locator 1.9 | /repstuff/robots.txt?crawlerName=* |
| 65.54.165.43 | 2008-01-30 06:47:15 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.54.165.43 | 2008-01-30 06:47:16 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 82.198.66.65 | 2008-01-30 16:57:11 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.stomol.ru%2Fcatalog%2Fafa%2Fcupem%2F |
| 82.198.66.65 | 2008-01-30 16:57:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.alonsaunet.com%2Fwebmaster%2Fzixe%2Frusuji%2F |
| 82.198.66.65 | 2008-01-30 16:57:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 212.239.181.147 | 2008-01-31 05:56:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 59.106.82.251 | 2008-02-01 14:35:33 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 59.106.82.251 | 2008-02-02 04:14:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-02-03 03:01:55 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.14 | 2008-02-03 03:04:09 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-02-03 03:04:55 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-02-03 03:05:34 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.14 | 2008-02-03 03:07:06 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-02-03 03:08:32 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.14 | 2008-02-03 03:10:08 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-02-03 03:10:53 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-02-03 03:11:37 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-02-03 03:13:45 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 77.102.43.119 | 2008-02-03 14:06:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 77.102.43.119 | 2008-02-03 14:06:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 195.12.0.198 | 2008-02-04 05:42:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 195.12.0.198 | 2008-02-04 05:43:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Teoma |
| 196.203.246.107 | 2008-02-05 03:21:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 80.86.106.220 | 2008-02-05 06:47:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.channelnewsperu.com%2Fimagenes%2Fpublicaciones%2Ffotos%2Fnepicu%2Fegul%2F |
| 80.86.106.220 | 2008-02-05 06:47:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.soeasywebsite.com%2Fsoeasycasino%2Fixu%2Fxotem%2F |
| 80.86.106.220 | 2008-02-05 06:47:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fsinzinuri.com%2Fimsi%2Fdb%2Fpic%2Fbezefi%2Fugoye%2F |
| 169.139.221.252 | 2008-02-05 09:41:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 169.139.221.252 | 2008-02-05 09:41:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 212.27.212.38 | 2008-02-05 10:58:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.pattibus.it%2Fphplib-7.2b%2Fpages%2Filosi%2Fdohigal%2F |
| 212.27.212.38 | 2008-02-05 10:58:16 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.northfans.ch%2Fforum%2Fadmin%2Fsettings%2Fgucor%2Fujusu%2F |
| 212.27.212.38 | 2008-02-05 10:58:16 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.ce-cioceoforum.com%2Ftalk%2Ft1%2Froda%2Filubov%2F |
| 59.106.82.243 | 2008-02-07 13:09:59 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 59.106.82.251 | 2008-02-08 02:00:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 82.152.40.18 | 2008-02-08 03:50:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 82.152.40.18 | 2008-02-08 03:51:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 82.152.40.18 | 2008-02-08 03:51:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 65.55.104.23 | 2008-02-10 22:19:23 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.104.23 | 2008-02-10 22:25:16 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.104.23 | 2008-02-10 22:25:16 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.104.23 | 2008-02-10 22:25:16 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.104.23 | 2008-02-10 22:25:17 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.104.23 | 2008-02-10 22:25:17 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.104.23 | 2008-02-10 22:25:18 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.104.23 | 2008-02-10 22:25:18 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 65.55.104.23 | 2008-02-10 22:25:20 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.104.23 | 2008-02-10 22:25:20 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.202.30.212 | 2008-02-11 02:59:39 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt |
| 67.202.30.212 | 2008-02-11 02:59:52 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.202.30.212 | 2008-02-11 03:00:00 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=msnbot |
| 67.202.30.212 | 2008-02-11 03:01:02 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Teoma |
| 67.202.30.212 | 2008-02-11 03:01:50 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 67.202.30.212 | 2008-02-11 03:02:02 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=* |
| 67.202.30.212 | 2008-02-11 03:02:31 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Slurp |
| 67.202.30.212 | 2008-02-11 03:02:56 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.202.30.212 | 2008-02-11 03:03:11 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.202.30.212 | 2008-02-11 03:03:39 | 200-OK | Mozilla/5.0 (compatible; page-store +http://www.page-store.com) [email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 193.126.103.183 | 2008-02-11 08:45:31 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; InfoPath.1) | /repstuff/robots.txt?crawlerName=* |
| 217.169.46.98 | 2008-02-11 23:19:11 | 200-OK | Mozilla/4.0 | /repstuff/robots.txt |
| 168.187.10.42 | 2008-02-11 23:19:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 217.149.44.21 | 2008-02-12 03:31:23 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 217.149.44.21 | 2008-02-12 03:31:40 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 217.149.44.21 | 2008-02-12 03:31:54 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 68.191.201.2 | 2008-02-12 20:08:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 38.99.13.124 | 2008-02-12 22:23:46 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=* |
| 38.99.13.124 | 2008-02-12 23:26:10 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 38.99.13.124 | 2008-02-13 03:02:01 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 38.99.13.124 | 2008-02-13 11:10:35 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 165.21.154.8 | 2008-02-13 12:50:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 38.99.13.124 | 2008-02-13 19:43:36 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 38.99.13.124 | 2008-02-13 20:01:25 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt |
| 72.186.142.128 | 2008-02-15 17:23:29 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 72.186.142.128 | 2008-02-15 17:23:40 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 68.191.201.2 | 2008-02-15 21:36:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 68.191.201.2 | 2008-02-17 10:13:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 68.191.201.2 | 2008-02-19 03:59:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 84.55.127.146 | 2008-02-19 05:45:21 | 200-OK | Opera/9.24 (Macintosh; Intel Mac OS X; U; en) | /repstuff/robots.txt |
| 84.55.127.146 | 2008-02-19 05:45:37 | 200-OK | Opera/9.24 (Macintosh; Intel Mac OS X; U; en) | /repstuff/robots.txt?crawlerName=Googlebot |
| 68.230.97.220 | 2008-02-19 13:41:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 59.106.82.243 | 2008-02-20 01:45:44 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 62.147.174.207 | 2008-02-20 02:32:26 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20080207 Ubuntu/7.10 (gutsy) Firefox/2.0.0.12 | /repstuff/robots.txt |
| 62.147.174.207 | 2008-02-20 02:32:41 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20080207 Ubuntu/7.10 (gutsy) Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 146.209.130.1 | 2008-02-20 12:49:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 24.213.86.161 | 2008-02-21 22:28:37 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 62.139.252.216 | 2008-02-22 09:11:34 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=msnbot |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=Teoma |
| 74.86.244.130 | 2008-02-24 05:36:03 | 200-OK | WinHTTP Robot/1.0 | /repstuff/robots.txt?crawlerName=* |
| 209.240.206.212 | 2008-02-24 12:51:00 | 200-OK | Mozilla/4.0 WebTV/2.6 (compatible; MSIE 4.0) | /repstuff/robots.txt |
| 67.202.51.208 | 2008-02-24 21:52:04 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Teoma |
| 67.202.51.208 | 2008-02-24 21:53:03 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.202.51.208 | 2008-02-24 21:54:03 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.202.51.208 | 2008-02-24 21:54:52 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt |
| 67.202.51.208 | 2008-02-24 21:57:57 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=msnbot |
| 67.202.51.208 | 2008-02-24 21:58:29 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.202.51.208 | 2008-02-24 21:59:45 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=* |
| 67.202.51.208 | 2008-02-24 22:00:28 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Slurp |
| 67.202.51.208 | 2008-02-24 22:00:51 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 124.138.233.2 | 2008-02-24 22:01:03 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 124.138.233.2 | 2008-02-24 22:01:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.202.51.208 | 2008-02-24 22:04:40 | 200-OK | zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com] | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 72.67.155.46 | 2008-02-25 20:46:53 | 200-OK | Opera/9.26 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Slurp |
| 61.68.213.133 | 2008-02-26 01:02:52 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 61.68.213.133 | 2008-02-26 01:02:56 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 68.191.201.2 | 2008-02-26 08:16:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 222.124.93.96 | 2008-02-27 16:19:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080208 Firefox/2.0.0.12 (SSE PGO) | /repstuff/robots.txt |
| 69.72.250.170 | 2008-02-27 16:58:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.tureksfuar.com.tr%2Fjoomla%2Fmambots%2Fcontent%2Fugi%2Fvipo%2F |
| 69.72.250.170 | 2008-02-27 16:58:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.felixtorresycia.com%2Fadmin%2Fcorreo%2Fenaq%2Fecib%2F |
| 69.72.250.170 | 2008-02-27 16:58:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fsans-packing.ru%2Fimg%2Fjipeqap%2Fehudute%2F |
| 69.72.250.170 | 2008-02-27 16:58:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Teoma |
| 68.191.201.2 | 2008-02-28 05:03:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 38.113.19.224 | 2008-02-28 10:18:10 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 38.113.19.224 | 2008-02-28 10:18:12 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 63.87.113.41 | 2008-02-28 14:35:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 63.87.113.41 | 2008-02-28 14:35:57 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 63.87.113.41 | 2008-02-28 14:36:07 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 63.87.113.41 | 2008-02-28 14:36:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Teoma |
| 63.87.113.41 | 2008-02-28 14:36:23 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 63.87.113.41 | 2008-02-28 14:36:24 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 63.87.113.41 | 2008-02-28 14:36:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 63.87.113.41 | 2008-02-28 14:36:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 63.87.113.41 | 2008-02-28 14:36:26 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 63.87.113.41 | 2008-02-28 14:36:27 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Slurp |
| 63.87.113.41 | 2008-02-28 14:36:27 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=msnbot |
| 63.87.113.41 | 2008-02-28 14:36:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Teoma |
| 63.87.113.41 | 2008-02-28 14:36:30 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 76.90.52.54 | 2008-02-28 16:08:30 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 76.90.52.54 | 2008-02-28 16:08:49 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 76.90.52.54 | 2008-02-28 16:08:56 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.208.172.179 | 2008-02-28 17:55:08 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 64.208.172.179 | 2008-02-28 17:57:44 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 83.73.226.224 | 2008-02-28 19:36:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; da; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.208.172.179 | 2008-02-29 01:40:26 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.208.172.179 | 2008-02-29 01:40:43 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.208.172.179 | 2008-02-29 01:40:51 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 64.208.172.179 | 2008-02-29 01:41:11 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 64.208.172.179 | 2008-02-29 01:41:22 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=msnbot |
| 64.208.172.179 | 2008-02-29 01:43:50 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2008-02-29 01:43:55 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.208.172.179 | 2008-02-29 01:44:06 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Slurp |
| 64.208.172.179 | 2008-02-29 01:44:25 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Teoma |
| 68.191.201.2 | 2008-03-01 01:08:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 76.117.227.192 | 2008-03-01 13:14:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 76.117.227.192 | 2008-03-01 13:14:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 90.40.184.37 | 2008-03-01 14:34:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Slurp |
| 90.40.184.37 | 2008-03-01 14:35:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET | /repstuff/robots.txt?crawlerName=Googlebot |
| 90.40.184.37 | 2008-03-01 14:38:33 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=msnbot |
| 90.40.184.37 | 2008-03-01 14:48:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 68.191.201.2 | 2008-03-02 23:37:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 90.80.39.41 | 2008-03-03 04:40:06 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.8) Gecko/20071008 Firefox/2.0.0.8 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 99.229.124.11 | 2008-03-03 16:16:47 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; YPC 3.2.0) | /repstuff/robots.txt |
| 220.181.41.74 | 2008-03-04 09:16:25 | 200-OK | ninetowns | /repstuff/robots.txt |
| 220.181.41.74 | 2008-03-04 09:16:26 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Googlebot |
| 220.181.41.74 | 2008-03-04 09:16:27 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 220.181.41.74 | 2008-03-04 09:16:28 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 220.181.41.74 | 2008-03-04 09:16:29 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 220.181.41.74 | 2008-03-04 09:16:30 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 220.181.41.74 | 2008-03-04 09:16:31 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Slurp |
| 220.181.41.74 | 2008-03-04 09:16:32 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=msnbot |
| 220.181.41.74 | 2008-03-04 09:16:33 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=Teoma |
| 220.181.41.74 | 2008-03-04 09:16:34 | 200-OK | ninetowns | /repstuff/robots.txt?crawlerName=* |
| 68.63.181.87 | 2008-03-04 13:31:34 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 68.63.181.87 | 2008-03-04 13:32:04 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Slurp |
| 82.194.66.70 | 2008-03-04 21:01:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.obrasmecanicasch.com%2Fomch%2Fimg%2Fitofu%2Fviroja%2F |
| 82.194.66.70 | 2008-03-04 21:01:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.altaiseer-eg.com%2Far%2Farticles%2Fjed%2Fumut%2F |
| 82.194.66.70 | 2008-03-04 21:01:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fsahel55.com%2Farticles%2Fomaduro%2Fkimumid%2F |
| 82.194.66.70 | 2008-03-04 21:02:25 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=msnbot |
| 24.36.228.2 | 2008-03-04 21:04:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 24.36.228.2 | 2008-03-04 21:05:07 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 68.191.201.2 | 2008-03-05 11:38:28 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 72.79.90.15 | 2008-03-06 12:14:31 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b3) Gecko/2008020514 Firefox/3.0b3 | /repstuff/robots.txt |
| 72.79.90.15 | 2008-03-06 12:14:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b3) Gecko/2008020514 Firefox/3.0b3 | /repstuff/robots.txt?crawlerName=Slurp |
| 72.79.90.15 | 2008-03-06 12:15:02 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9b3) Gecko/2008020514 Firefox/3.0b3 | /repstuff/robots.txt |
| 68.191.201.2 | 2008-03-07 09:46:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 67.228.100.138 | 2008-03-08 08:09:37 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt |
| 67.228.100.138 | 2008-03-08 08:09:37 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt |
| 67.228.100.138 | 2008-03-08 08:09:37 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.228.100.138 | 2008-03-08 08:09:38 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 67.228.100.138 | 2008-03-08 08:09:38 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.228.100.138 | 2008-03-08 08:09:38 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 67.228.100.138 | 2008-03-08 08:09:38 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 67.228.100.138 | 2008-03-08 08:09:39 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=msnbot |
| 67.228.100.138 | 2008-03-08 08:09:40 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=msnbot |
| 67.228.100.138 | 2008-03-08 08:09:40 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Teoma |
| 67.228.100.138 | 2008-03-08 08:09:40 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=Teoma |
| 67.228.100.138 | 2008-03-08 08:09:40 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=* |
| 67.228.100.138 | 2008-03-08 08:09:40 | 200-OK | ShablastBot 1.0 | /repstuff/robots.txt?crawlerName=* |
| 88.107.253.24 | 2008-03-08 10:58:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 88.107.253.24 | 2008-03-08 10:58:35 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 88.107.253.24 | 2008-03-08 10:58:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 85.178.249.193 | 2008-03-09 08:16:04 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20061201 Firefox/2.0.0.12 (Ubuntu-feisty) | /repstuff/robots.txt |
| 85.178.249.193 | 2008-03-09 08:16:15 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20061201 Firefox/2.0.0.12 (Ubuntu-feisty) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.178.249.193 | 2008-03-09 08:16:26 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.12) Gecko/20061201 Firefox/2.0.0.12 (Ubuntu-feisty) | /repstuff/robots.txt?crawlerName=* |
| 38.99.13.124 | 2008-03-10 11:01:17 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 195.238.59.204 | 2008-03-11 11:14:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 38.99.13.124 | 2008-03-11 22:54:52 | 200-OK | Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 38.116.11.115 | 2008-03-13 08:44:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 38.116.11.115 | 2008-03-13 08:44:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 193.120.116.179 | 2008-03-13 11:28:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322) | /repstuff/robots.txt |
| 77.91.224.14 | 2008-03-13 23:44:41 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.14 | 2008-03-13 23:46:53 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-03-13 23:47:42 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-03-13 23:48:30 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.14 | 2008-03-13 23:49:53 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-03-13 23:51:29 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.14 | 2008-03-13 23:52:52 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-03-13 23:53:47 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-03-13 23:54:34 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-03-13 23:56:52 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 66.211.223.18 | 2008-03-14 07:18:25 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.11) Gecko/20071201 PCLinuxOS/2.0.0.11-1pclos2007 (2007) Firefox/2.0.0.11 | /repstuff/robots.txt |
| 66.211.223.18 | 2008-03-14 07:18:45 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.11) Gecko/20071201 PCLinuxOS/2.0.0.11-1pclos2007 (2007) Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot |
| 66.211.223.18 | 2008-03-14 10:42:17 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.11) Gecko/20071201 PCLinuxOS/2.0.0.11-1pclos2007 (2007) Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=* |
| 82.229.17.134 | 2008-03-15 10:29:31 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.sacred-fr.com%2Fforums%2Fimages%2Favatars%2Fedoxi%2Fruciwu%2F |
| 82.229.17.134 | 2008-03-15 10:29:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.caneus.org%2Fbbs%2Fcom%2Fattachments%2Fzixoz%2Frifojax%2Fyow%2F |
| 82.229.17.134 | 2008-03-15 10:29:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.blankner.ocps.net%2Fmedia%2Fimages%2Fefepi%2Fasopuy%2F |
| 68.191.201.2 | 2008-03-15 10:53:35 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-03-15 15:45:31 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-03-15 15:45:39 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-03-15 15:47:34 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-03-15 15:48:19 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.14 | 2008-03-15 15:48:37 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-03-15 15:50:27 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.14 | 2008-03-15 15:51:28 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-03-15 15:53:17 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.14 | 2008-03-15 15:53:37 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.14 | 2008-03-15 15:54:26 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 77.91.224.4 | 2008-03-16 23:17:23 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-03-16 23:18:09 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-03-16 23:19:30 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-03-16 23:20:17 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.14 | 2008-03-16 23:21:02 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-03-16 23:22:28 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.4 | 2008-03-16 23:23:13 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.14 | 2008-03-16 23:23:58 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-03-16 23:25:24 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.14 | 2008-03-16 23:27:13 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 66.52.142.3 | 2008-03-17 04:28:14 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 68.191.201.2 | 2008-03-17 06:29:35 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-03-18 08:10:21 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.14 | 2008-03-18 08:10:23 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.14 | 2008-03-18 08:12:30 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.14 | 2008-03-18 08:13:15 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-03-18 08:13:15 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.14 | 2008-03-18 08:15:21 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.4 | 2008-03-18 08:16:11 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.14 | 2008-03-18 08:18:16 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-03-18 08:18:20 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-03-18 08:19:06 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 4.242.9.176 | 2008-03-18 13:23:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-CB; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 4.242.9.176 | 2008-03-18 13:23:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-CB; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 59.106.82.243 | 2008-03-19 05:21:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 68.191.201.2 | 2008-03-19 06:58:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 59.106.82.243 | 2008-03-19 08:28:24 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.106.82.243 | 2008-03-19 08:30:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 59.106.82.243 | 2008-03-19 09:06:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Teoma |
| 59.106.82.243 | 2008-03-19 09:18:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt |
| 59.106.82.243 | 2008-03-19 10:07:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=msnbot |
| 59.106.82.243 | 2008-03-19 10:14:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 59.106.82.243 | 2008-03-19 10:14:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 59.106.82.243 | 2008-03-19 13:04:52 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 59.106.82.243 | 2008-03-19 13:09:22 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Slurp |
| 66.91.179.181 | 2008-03-20 21:06:40 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 66.91.179.181 | 2008-03-20 21:06:59 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot |
| 66.91.179.181 | 2008-03-21 01:35:38 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 59.106.82.251 | 2008-03-21 06:31:55 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 68.191.201.2 | 2008-03-21 08:04:37 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 59.106.82.243 | 2008-03-21 09:40:00 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.106.82.243 | 2008-03-21 09:42:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 59.106.82.251 | 2008-03-21 10:19:19 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Teoma |
| 59.106.82.251 | 2008-03-21 10:30:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt |
| 59.106.82.251 | 2008-03-21 11:20:55 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=msnbot |
| 59.106.82.243 | 2008-03-21 11:27:44 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 59.106.82.243 | 2008-03-21 11:27:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 59.106.82.243 | 2008-03-21 14:22:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 59.106.82.243 | 2008-03-21 14:27:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Slurp |
| 72.229.114.168 | 2008-03-22 14:40:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 72.90.71.132 | 2008-03-23 16:03:31 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt |
| 72.90.71.132 | 2008-03-23 16:03:34 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=* |
| 72.90.71.132 | 2008-03-23 16:03:37 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 72.90.71.132 | 2008-03-23 16:03:40 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.90.71.132 | 2008-03-23 16:03:42 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 72.90.71.132 | 2008-03-23 16:03:45 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 72.90.71.132 | 2008-03-23 16:03:48 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.90.71.132 | 2008-03-23 16:03:51 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Slurp |
| 72.90.71.132 | 2008-03-23 16:03:53 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=Teoma |
| 72.90.71.132 | 2008-03-23 16:03:57 | 200-OK | Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) | /repstuff/robots.txt?crawlerName=msnbot |
| 68.191.201.2 | 2008-03-23 20:40:31 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 59.106.82.251 | 2008-03-24 02:18:16 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=* |
| 59.106.82.251 | 2008-03-24 05:25:59 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.106.82.251 | 2008-03-24 05:28:31 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 59.106.82.251 | 2008-03-24 06:05:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Teoma |
| 59.106.82.251 | 2008-03-24 06:17:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt |
| 59.106.82.251 | 2008-03-24 07:07:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=msnbot |
| 59.106.82.251 | 2008-03-24 07:14:10 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 59.106.82.251 | 2008-03-24 07:14:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 86.29.87.108 | 2008-03-24 09:29:32 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 86.29.87.108 | 2008-03-24 09:30:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 59.106.82.251 | 2008-03-24 10:09:57 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 59.106.82.251 | 2008-03-24 10:14:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; ja; rv:1.8.1.7) Gecko/20070914 Firefox/2.0.0.7/Mozilla/5.0 (MaSagool; http://sagool.jp/) | /repstuff/robots.txt?crawlerName=Slurp |
| 68.191.201.2 | 2008-03-26 14:56:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 84.28.46.105 | 2008-03-27 04:15:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 84.28.46.105 | 2008-03-27 04:16:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 193.52.48.67 | 2008-03-27 05:57:12 | 200-OK | Java/1.6.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 213.5.25.213 | 2008-03-27 08:18:46 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Avant Browser; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; FDM; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2) | /repstuff/robots.txt |
| 213.5.25.213 | 2008-03-27 08:18:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Avant Browser; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; FDM; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; InfoPath.2) | /repstuff/robots.txt?crawlerName=* |
| 85.136.236.111 | 2008-03-27 08:51:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; es-ES; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 125.248.69.130 | 2008-03-27 09:52:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.asigurareamea.ro%2Fupload_fisiere%2Fibanar%2Fsuxokud%2F |
| 125.248.69.130 | 2008-03-27 09:52:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.channelnewsperu.com%2Fimagenes%2Fpublicaciones%2Ffotos%2Femesuki%2Fohuhud%2F |
| 125.248.69.130 | 2008-03-27 09:52:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.tcmforum.com%2Fweb%2Fsal%2Fyuveli%2F |
| 63.246.27.143 | 2008-03-27 17:43:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.landisempach-emmen.ch%2Faktionen%2Fimage%2Fezu%2Fotitob%2F |
| 63.246.27.143 | 2008-03-27 17:43:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.thoseguysfilms.com%2Fforums%2Ftemplates%2FsubSilver%2Fimages%2Ftimuji%2Fogu%2F |
| 63.246.27.143 | 2008-03-27 17:43:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.foicr.org%2Fwork%2Fmulito%2Fvom%2F |
| 63.246.27.143 | 2008-03-27 17:43:42 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 76.24.197.26 | 2008-03-28 04:49:13 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 76.24.197.26 | 2008-03-28 04:49:21 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 76.24.197.26 | 2008-03-28 14:30:37 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt |
| 76.24.197.26 | 2008-03-28 14:30:37 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 24.186.215.209 | 2008-03-28 22:38:07 | 200-OK | Firefox | /repstuff/robots.txt?crawlerName=Googlebot |
| 24.186.215.209 | 2008-03-28 22:38:22 | 200-OK | Firefox | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 76.90.81.231 | 2008-03-29 14:53:33 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_4_11; en) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt |
| 76.90.81.231 | 2008-03-29 14:53:48 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_4_11; en) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 76.90.81.231 | 2008-03-29 14:54:02 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_4_11; en) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 76.90.81.231 | 2008-03-29 14:54:08 | 200-OK | Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_4_11; en) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt?crawlerName=* |
| 64.208.172.179 | 2008-03-30 17:25:19 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 64.208.172.179 | 2008-03-30 17:32:01 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 77.250.125.237 | 2008-03-31 16:23:52 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.250.125.237 | 2008-03-31 16:24:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 212.219.86.184 | 2008-04-01 02:56:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=* |
| 212.219.86.184 | 2008-04-01 02:57:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Slurp |
| 69.243.153.202 | 2008-04-02 12:43:39 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; Embedded Web Browser from: http://bsalsa.com/; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 69.243.153.202 | 2008-04-02 12:43:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; Embedded Web Browser from: http://bsalsa.com/; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.51.38.94 | 2008-04-02 18:00:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.garten-punzmann.de%2FRedSys%2Fuploader%2Fimages_uploads%2Ffes%2Fesered%2F |
| 72.51.38.94 | 2008-04-02 18:00:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.fabcraft.co.uk%2Fforum%2Fugak%2Fmiketat%2F |
| 72.51.38.94 | 2008-04-02 18:00:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.thoseguysfilms.com%2Fforums%2Ftemplates%2FsubSilver%2Fimages%2Ftimuji%2Fogu%2F |
| 72.51.38.94 | 2008-04-02 18:00:35 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.51.38.94 | 2008-04-02 18:00:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.96.54.74 | 2008-04-03 05:22:27 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:27:57 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:28:00 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:28:00 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:28:12 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:28:15 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:28:59 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:29:08 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.74 | 2008-04-03 05:30:18 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 122.169.106.148 | 2008-04-03 07:53:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.11;MEGAUPLOAD 1.0 | /repstuff/robots.txt?crawlerName=* |
| 74.93.82.217 | 2008-04-03 14:49:53 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 74.93.82.217 | 2008-04-03 14:50:29 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 71.184.113.243 | 2008-04-05 10:58:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 71.184.113.243 | 2008-04-05 10:58:19 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 84.51.36.154 | 2008-04-08 00:30:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 87.210.32.58 | 2008-04-08 21:14:53 | 200-OK | Java/1.4.1_04 | /repstuff/robots.txt |
| 12.162.23.66 | 2008-04-09 19:18:37 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 12.162.23.66 | 2008-04-09 19:18:47 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Googlebot |
| 12.162.23.66 | 2008-04-09 19:19:02 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 12.162.23.66 | 2008-04-09 19:19:10 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=* |
| 65.55.104.215 | 2008-04-09 19:26:15 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.104.215 | 2008-04-09 19:34:17 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.70 | 2008-04-10 02:59:09 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:10 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:18 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:20 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:25 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:26 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:27 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:31 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:33 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.70 | 2008-04-10 02:59:37 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.101.45.18 | 2008-04-12 00:54:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.101.45.18 | 2008-04-12 00:54:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.101.45.18 | 2008-04-12 00:54:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.101.45.18 | 2008-04-12 00:54:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 218.208.198.70 | 2008-04-12 07:18:28 | 200-OK | Java/1.6.0_04 | /repstuff/robots.txt |
| 86.162.149.64 | 2008-04-13 07:15:33 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt |
| 86.162.149.64 | 2008-04-13 07:15:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt?crawlerName=Slurp |
| 84.155.126.3 | 2008-04-13 21:03:37 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 87.231.201.149 | 2008-04-16 02:13:46 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022) | /repstuff/robots.txt |
| 65.57.245.11 | 2008-04-17 13:36:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.57.245.11 | 2008-04-17 13:36:53 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt |
| 77.91.224.4 | 2008-04-17 15:49:57 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-04-17 15:52:07 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.4 | 2008-04-17 15:54:14 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-04-17 15:56:23 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-04-17 15:58:32 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-04-17 16:00:37 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.4 | 2008-04-17 16:02:45 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-04-17 16:04:55 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-04-17 16:07:03 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-04-17 16:09:10 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 208.101.45.18 | 2008-04-17 21:02:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 208.101.45.18 | 2008-04-17 21:02:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.101.45.18 | 2008-04-17 21:02:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 208.101.45.18 | 2008-04-17 21:02:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 208.101.45.18 | 2008-04-17 21:02:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.101.45.18 | 2008-04-17 21:02:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.101.45.18 | 2008-04-17 21:02:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.101.45.18 | 2008-04-17 21:02:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.101.45.18 | 2008-04-17 21:03:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.101.45.18 | 2008-04-17 21:03:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 64.62.142.170 | 2008-04-18 04:44:25 | 200-OK | Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) | /repstuff/robots.txt |
| 194.164.235.10 | 2008-04-18 08:01:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt |
| 194.164.235.10 | 2008-04-18 08:02:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.13) Gecko/20080311 Firefox/2.0.0.13 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.100.237.131 | 2008-04-18 18:38:26 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt |
| 77.100.237.131 | 2008-04-18 18:38:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.100.237.131 | 2008-04-18 18:38:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.73 | 2008-04-19 19:48:41 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 01:04:54 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 01:45:16 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 01:45:21 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 01:46:03 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 02:27:12 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.73 | 2008-04-20 03:08:27 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 66.249.85.67 | 2008-04-20 17:05:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 67.185.10.180 | 2008-04-20 17:05:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 68.191.201.2 | 2008-04-21 05:40:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 61.50.145.210 | 2008-04-21 05:51:32 | 200-OK | Opera/9.27 (Windows NT 5.1; U; ru) | /repstuff/robots.txt |
| 61.50.145.210 | 2008-04-21 05:51:52 | 200-OK | Opera/9.27 (Windows NT 5.1; U; ru) | /repstuff/robots.txt?crawlerName=Googlebot |
| 61.50.145.210 | 2008-04-21 05:52:22 | 200-OK | Opera/9.27 (Windows NT 5.1; U; ru) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 61.50.145.210 | 2008-04-21 05:52:35 | 200-OK | Opera/9.27 (Windows NT 5.1; U; ru) | /repstuff/robots.txt?crawlerName=* |
| 70.90.29.66 | 2008-04-21 13:41:20 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 70.90.29.66 | 2008-04-21 13:41:26 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 24.182.45.28 | 2008-04-22 04:13:44 | 200-OK | Java/1.6.0_04 | /repstuff/robots.txt |
| 65.55.25.147 | 2008-04-22 06:09:48 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.25.147 | 2008-04-22 06:15:58 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.25.147 | 2008-04-22 06:17:08 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 65.55.25.146 | 2008-04-22 06:30:38 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.25.146 | 2008-04-22 06:32:32 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.25.146 | 2008-04-22 06:35:38 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.25.146 | 2008-04-22 06:35:38 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.25.146 | 2008-04-22 06:42:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.25.146 | 2008-04-22 06:45:37 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.25.146 | 2008-04-22 06:51:10 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.250.125.237 | 2008-04-24 11:01:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 77.250.125.237 | 2008-04-24 11:01:54 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; nl; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-04-24 11:41:57 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.24.41.80 | 2008-04-24 11:53:41 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.14) Gecko/20080418 Ubuntu/7.10 (gutsy) Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.149 | 2008-04-24 12:19:43 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 68.191.201.2 | 2008-04-24 18:23:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 65.55.210.152 | 2008-04-24 21:06:33 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.210.158 | 2008-04-24 21:57:13 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.143 | 2008-04-25 12:34:57 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-04-25 12:35:00 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 142.46.227.65 | 2008-04-26 05:56:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 68.191.201.2 | 2008-04-27 10:24:39 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 194.54.110.111 | 2008-04-29 04:09:08 | 200-OK | Opera/9.27 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 203.16.33.250 | 2008-04-29 15:59:08 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 203.16.33.250 | 2008-04-29 15:59:46 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 202.144.61.68 | 2008-04-30 00:55:28 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1) | /repstuff/robots.txt?crawlerName=* |
| 209.234.171.43 | 2008-04-30 01:35:28 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 209.234.171.43 | 2008-04-30 01:35:33 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 209.234.171.43 | 2008-04-30 01:35:38 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 209.234.171.43 | 2008-04-30 01:38:29 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=* |
| 209.234.171.43 | 2008-04-30 01:38:34 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 209.234.171.43 | 2008-04-30 01:38:39 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 209.234.171.43 | 2008-04-30 01:38:44 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Slurp |
| 209.234.171.43 | 2008-04-30 01:38:49 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Teoma |
| 209.234.171.43 | 2008-04-30 01:38:56 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=msnbot |
| 209.234.171.43 | 2008-04-30 08:25:38 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 209.234.171.43 | 2008-04-30 08:47:30 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 208.96.54.75 | 2008-05-01 05:40:41 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 65.55.210.159 | 2008-05-01 06:16:10 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.75 | 2008-05-01 08:56:18 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.75 | 2008-05-01 09:47:55 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.96.54.75 | 2008-05-01 10:05:14 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.96.54.75 | 2008-05-01 10:14:21 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.96.54.75 | 2008-05-01 10:14:36 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.75 | 2008-05-01 10:42:10 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.96.54.75 | 2008-05-01 10:54:03 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 208.96.54.75 | 2008-05-01 11:06:46 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.96.54.75 | 2008-05-01 12:05:12 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-05-01 18:26:02 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-05-01 18:29:30 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.4 | 2008-05-01 18:30:45 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.3 | 2008-05-01 18:31:14 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.3 | 2008-05-01 18:34:11 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-05-01 18:34:16 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.3 | 2008-05-01 18:36:34 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-05-01 18:36:42 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.3 | 2008-05-01 18:37:44 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-05-01 18:40:11 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 91.64.239.10 | 2008-05-02 17:59:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.8.1.11) Gecko/20071127 Firefox/2.0.0.11 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 76.109.42.196 | 2008-05-02 20:01:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; MSDigitalLocker; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 2.0.50727; .NET CLR 3.0.04506.590; .NET CLR 3.5.20706; .NET CLR 1.1.4322; Alexa Toolbar) | /repstuff/robots.txt |
| 76.109.42.196 | 2008-05-02 20:02:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; MSDigitalLocker; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 2.0.50727; .NET CLR 3.0.04506.590; .NET CLR 3.5.20706; .NET CLR 1.1.4322; Alexa Toolbar) | /repstuff/robots.txt?crawlerName=Googlebot |
| 76.109.42.196 | 2008-05-02 20:10:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; MSDigitalLocker; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 2.0.50727; .NET CLR 3.0.04506.590; .NET CLR 3.5.20706; .NET CLR 1.1.4322; Alexa Toolbar) | /repstuff/robots.txt?crawlerName=* |
| 69.250.106.44 | 2008-05-02 21:29:11 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt |
| 69.250.106.44 | 2008-05-02 21:29:22 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Googlebot |
| 69.250.106.44 | 2008-05-02 21:29:41 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 69.250.106.44 | 2008-05-02 21:29:48 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 69.250.106.44 | 2008-05-02 21:29:53 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=msnbot |
| 69.250.106.44 | 2008-05-02 21:29:59 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Slurp |
| 69.250.106.44 | 2008-05-02 21:30:03 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Teoma |
| 69.250.106.44 | 2008-05-02 21:30:09 | 200-OK | Opera/9.50 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.71 | 2008-05-02 23:15:12 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.71 | 2008-05-03 02:23:57 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.71 | 2008-05-03 02:38:51 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.153 | 2008-05-03 14:02:28 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.210.156 | 2008-05-03 20:35:53 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.152 | 2008-05-04 04:53:55 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.210.154 | 2008-05-04 12:00:13 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 84.144.56.66 | 2008-05-04 12:37:16 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20070723 Iceweasel/2.0.0.6 (Debian-2.0.0.6-0etch1+lenny1) | /repstuff/robots.txt |
| 84.144.56.66 | 2008-05-04 12:37:27 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20070723 Iceweasel/2.0.0.6 (Debian-2.0.0.6-0etch1+lenny1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 84.144.56.66 | 2008-05-04 13:16:47 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.6) Gecko/20070723 Iceweasel/2.0.0.6 (Debian-2.0.0.6-0etch1+lenny1) | /repstuff/robots.txt |
| 68.191.201.2 | 2008-05-04 13:25:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 65.55.210.150 | 2008-05-04 13:34:49 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-05-04 14:49:08 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-05-05 00:17:02 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 78.129.208.20 | 2008-05-05 09:24:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 78.129.208.20 | 2008-05-05 09:24:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot |
| 78.129.208.20 | 2008-05-05 09:24:05 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 78.129.208.20 | 2008-05-05 09:24:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 78.129.208.20 | 2008-05-05 09:24:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 78.129.208.20 | 2008-05-05 09:24:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 78.129.208.20 | 2008-05-05 09:24:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Slurp |
| 78.129.208.20 | 2008-05-05 09:24:07 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=msnbot |
| 78.129.208.20 | 2008-05-05 09:24:07 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Teoma |
| 78.129.208.20 | 2008-05-05 09:24:07 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 196.207.40.149 | 2008-05-05 11:47:48 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_2; en-us) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt |
| 196.207.40.149 | 2008-05-05 11:47:50 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_2; en-us) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13 | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.143 | 2008-05-05 15:33:38 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.210.143 | 2008-05-05 15:36:49 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 70.88.145.57 | 2008-05-05 16:33:04 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.14eol) Gecko/20080418 Ubuntu/dapper-security Firefox/1.5.0.12eol | /repstuff/robots.txt |
| 208.96.54.73 | 2008-05-05 16:34:03 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.67 | 2008-05-05 23:09:14 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 208.96.54.67 | 2008-05-06 02:11:45 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.67 | 2008-05-06 02:48:42 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.67 | 2008-05-06 02:48:44 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.96.54.67 | 2008-05-06 02:50:09 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.96.54.67 | 2008-05-06 03:04:54 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.96.54.67 | 2008-05-06 03:27:16 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.96.54.67 | 2008-05-06 03:52:28 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 208.96.54.67 | 2008-05-06 04:02:07 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.96.54.67 | 2008-05-06 04:17:49 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.210.152 | 2008-05-06 07:53:30 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 69.108.230.30 | 2008-05-06 18:47:42 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 69.108.230.30 | 2008-05-06 18:48:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 69.108.230.30 | 2008-05-06 18:48:37 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 68.191.201.2 | 2008-05-07 07:43:26 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 66.135.107.234 | 2008-05-07 13:41:20 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 66.135.107.234 | 2008-05-07 13:41:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.96.54.74 | 2008-05-07 22:57:09 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 58.60.14.236 | 2008-05-08 08:17:34 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt |
| 58.60.13.231 | 2008-05-08 08:17:43 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 58.60.14.236 | 2008-05-08 08:17:45 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=* |
| 58.60.13.231 | 2008-05-08 08:17:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 121.14.96.153 | 2008-05-08 08:18:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot |
| 58.60.13.231 | 2008-05-08 08:18:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 58.60.14.236 | 2008-05-08 08:18:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 121.14.96.153 | 2008-05-08 08:18:37 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Teoma |
| 121.14.96.153 | 2008-05-08 08:18:45 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=msnbot |
| 58.60.14.231 | 2008-05-08 08:19:22 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Slurp |
| 86.121.119.7 | 2008-05-08 12:05:53 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 124.6.164.110 | 2008-05-10 04:54:39 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12 | /repstuff/robots.txt?crawlerName=* |
| 62.163.33.63 | 2008-05-10 11:20:22 | 200-OK | Java/1.6.0_04 | /repstuff/robots.txt |
| 65.55.210.159 | 2008-05-11 08:48:11 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 198.103.167.20 | 2008-05-12 10:19:13 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 198.103.167.20 | 2008-05-12 10:19:22 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 198.103.167.20 | 2008-05-12 10:19:28 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.153 | 2008-05-13 15:57:00 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.96.54.73 | 2008-05-13 18:14:49 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 65.55.210.156 | 2008-05-13 22:37:08 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.73 | 2008-05-13 23:17:29 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.73 | 2008-05-13 23:53:05 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.96.54.73 | 2008-05-14 01:32:19 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 208.96.54.68 | 2008-05-14 01:56:45 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.68 | 2008-05-14 01:57:10 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.96.54.68 | 2008-05-14 03:02:29 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.96.54.68 | 2008-05-14 03:37:25 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 208.96.54.71 | 2008-05-14 04:01:27 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.96.54.68 | 2008-05-14 04:08:04 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 8.10.67.218 | 2008-05-14 11:38:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 65.55.210.154 | 2008-05-14 14:16:43 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-05-14 15:21:56 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-05-14 16:42:41 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-05-15 02:16:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.143 | 2008-05-15 18:34:35 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-05-15 18:34:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 74.232.84.141 | 2008-05-15 19:15:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 74.232.84.141 | 2008-05-15 19:15:56 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 74.232.84.141 | 2008-05-15 19:15:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 74.232.84.141 | 2008-05-15 19:16:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 74.232.84.141 | 2008-05-15 19:16:11 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.152 | 2008-05-16 10:33:37 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 38.103.63.17 | 2008-05-17 00:25:58 | 200-OK | CCBot/1.0 (+http://www.commoncrawl.org/bot.html) | /repstuff/robots.txt |
| 68.191.201.2 | 2008-05-17 20:49:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 24.127.16.173 | 2008-05-18 05:43:39 | 200-OK | /repstuff/robots.txt?crawlerName=Googlebot | |
| 24.127.16.173 | 2008-05-18 06:52:18 | 200-OK | /repstuff/robots.txt?crawôlerName=Googlebot-Mobile | |
| 84.12.230.122 | 2008-05-19 01:44:21 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 (CK-Orange) Firefox/2.0.0.14 | /repstuff/robots.txt |
| 84.12.230.122 | 2008-05-19 01:44:38 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 (CK-Orange) Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 84.12.230.122 | 2008-05-19 01:44:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.14) Gecko/20080404 (CK-Orange) Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 4.131.81.62 | 2008-05-20 01:00:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 4.131.81.62 | 2008-05-20 01:00:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Teoma |
| 64.13.160.16 | 2008-05-20 04:37:02 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.17.173.6 | 2008-05-20 17:36:12 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 85.17.173.6 | 2008-05-20 17:36:12 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 85.17.173.6 | 2008-05-20 17:36:12 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 85.17.173.6 | 2008-05-20 17:36:13 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 85.17.173.6 | 2008-05-20 17:36:14 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 85.17.173.6 | 2008-05-20 17:36:14 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 85.17.173.6 | 2008-05-20 17:36:14 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 85.17.173.6 | 2008-05-20 17:36:14 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.17.173.6 | 2008-05-20 17:36:16 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 85.17.173.6 | 2008-05-20 17:36:17 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 68.191.201.2 | 2008-05-20 17:47:31 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 62.163.33.63 | 2008-05-21 01:52:38 | 200-OK | Java/1.6.0_05 | /repstuff/robots.txt |
| 65.55.210.159 | 2008-05-21 10:56:31 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 85.136.137.103 | 2008-05-22 03:20:37 | 200-OK | Opera/9.26 (Windows NT 5.1; U; es-la) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.210.153 | 2008-05-23 17:06:51 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 68.191.201.2 | 2008-05-23 20:08:50 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 65.55.210.156 | 2008-05-24 01:35:27 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 85.17.173.1 | 2008-05-24 02:10:14 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 85.17.173.1 | 2008-05-24 02:10:15 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 85.17.173.1 | 2008-05-24 02:10:15 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 85.17.173.1 | 2008-05-24 02:10:15 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 85.17.173.1 | 2008-05-24 02:10:15 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 85.17.173.1 | 2008-05-24 02:10:16 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 85.17.173.1 | 2008-05-24 02:10:16 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 85.17.173.1 | 2008-05-24 02:10:16 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.17.173.1 | 2008-05-24 02:10:16 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 85.17.173.1 | 2008-05-24 02:10:17 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.154 | 2008-05-24 15:55:51 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-05-24 17:56:33 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-05-24 19:28:28 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-05-25 03:12:33 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.143 | 2008-05-25 20:12:53 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.210.143 | 2008-05-25 20:17:47 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 68.148.200.131 | 2008-05-25 21:38:06 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 68.148.200.131 | 2008-05-25 21:38:26 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.152 | 2008-05-26 12:53:26 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 202.146.253.4 | 2008-05-27 20:05:44 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 221.47.248.32 | 2008-05-28 10:36:17 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 221.47.248.32 | 2008-05-28 10:36:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 65.55.107.164 | 2008-05-29 00:37:48 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.107.164 | 2008-05-29 00:37:50 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.107.164 | 2008-05-29 00:38:04 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 194.221.133.226 | 2008-05-29 04:11:08 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 194.221.133.226 | 2008-05-29 04:12:14 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 194.221.133.226 | 2008-05-29 04:12:37 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 194.221.133.226 | 2008-05-29 04:12:42 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 194.221.133.226 | 2008-05-29 04:13:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt |
| 194.221.133.226 | 2008-05-29 04:13:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 65.55.107.165 | 2008-05-29 09:30:11 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.107.165 | 2008-05-29 09:30:23 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 89.149.242.226 | 2008-05-29 19:14:09 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt |
| 89.149.242.226 | 2008-05-29 19:15:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 89.149.242.226 | 2008-05-29 19:15:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot |
| 89.149.242.226 | 2008-05-29 19:15:31 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 89.149.242.226 | 2008-05-29 19:15:57 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 89.149.242.226 | 2008-05-29 19:16:29 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 89.149.242.226 | 2008-05-29 19:17:03 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Slurp |
| 89.149.242.226 | 2008-05-29 19:17:24 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=msnbot |
| 89.149.242.226 | 2008-05-29 19:17:44 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=Teoma |
| 89.149.242.226 | 2008-05-29 19:18:06 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 221.47.248.32 | 2008-05-30 12:02:47 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 221.47.248.32 | 2008-05-30 12:24:37 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 221.47.248.32 | 2008-05-30 12:24:50 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 221.47.248.32 | 2008-05-30 12:24:56 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 209.234.171.43 | 2008-05-30 13:08:44 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 209.234.171.43 | 2008-05-30 13:10:50 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 65.55.210.159 | 2008-05-31 12:18:06 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 195.229.236.210 | 2008-06-01 05:51:14 | 200-OK | Java/1.6.0_05 | /repstuff/robots.txt |
| 198.178.194.101 | 2008-06-01 14:13:10 | 200-OK | Vital Search\'n Urchin | /repstuff/robots.txt?crawlerName=Slurp |
| 198.178.194.101 | 2008-06-01 18:34:36 | 200-OK | Vital Search\'n Urchin | /repstuff/robots.txt?crawlerName=Slurp |
| 80.40.140.20 | 2008-06-02 00:09:58 | 200-OK | Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot) | /repstuff/robots.txt |
| 198.178.194.101 | 2008-06-02 16:05:11 | 200-OK | Vital Search\'n Urchin | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.153 | 2008-06-02 19:22:22 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.210.156 | 2008-06-03 03:42:03 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.154 | 2008-06-03 17:00:05 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-06-03 19:40:26 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-06-03 22:14:29 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-06-04 05:43:50 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.143 | 2008-06-04 22:24:42 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.210.143 | 2008-06-04 22:31:35 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 71.166.32.33 | 2008-06-05 07:48:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 71.166.32.33 | 2008-06-05 07:49:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 71.166.32.33 | 2008-06-05 07:49:07 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 71.166.32.33 | 2008-06-05 07:53:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 71.166.32.33 | 2008-06-05 08:00:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.152 | 2008-06-05 14:16:53 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 80.231.1.2 | 2008-06-06 04:39:43 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.elettrodataservice.it%2Ffoto_articoli%2Fpivafof%2Fmibi%2F |
| 80.231.1.2 | 2008-06-06 04:39:43 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.channelnewsperu.com%2Fimagenes%2Fpublicaciones%2Ffotos%2Femesuki%2Flewu%2F |
| 80.231.1.2 | 2008-06-06 04:39:43 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.blankner.ocps.net%2Fmedia%2Fyeloc%2Frepaw%2F |
| 80.231.1.2 | 2008-06-06 04:40:05 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 69.134.119.234 | 2008-06-06 14:31:48 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0 | /repstuff/robots.txt |
| 69.134.119.234 | 2008-06-06 14:31:59 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 69.134.119.234 | 2008-06-06 14:32:10 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 69.134.119.234 | 2008-06-06 14:32:14 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9) Gecko/2008052912 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 189.38.19.19 | 2008-06-06 15:13:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.boomerbible.com%2Finstapunk%2FMType%2Farchives%2Fajuq%2Favu%2F |
| 189.38.19.19 | 2008-06-06 15:13:16 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.sfolly.net%2Fchat%2Fdata%2Fpublic%2Fuvudap%2Fome%2F |
| 189.38.19.19 | 2008-06-06 15:13:16 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.tcmforum.com%2Flayout%2Foxiqade%2Fonese%2F |
| 189.38.19.19 | 2008-06-06 15:13:54 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.25.153.45 | 2008-06-07 01:58:20 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.unduetretoccaate.it%2Fcodice%2Ffog%2Fbiko%2F |
| 85.25.153.45 | 2008-06-07 01:58:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.filter-international.com%2Fwebservice%2Faro%2Fpefosi%2F |
| 85.25.153.45 | 2008-06-07 01:58:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fkamini.biz%2Fa%2Fonodin%2Fbb%2Faqileka%2Fseleyuy%2F |
| 85.25.153.45 | 2008-06-07 01:58:40 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Teoma |
| 64.124.85.78 | 2008-06-07 03:43:24 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 64.124.85.78 | 2008-06-07 03:48:55 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 64.124.85.78 | 2008-06-07 03:49:35 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 64.124.85.78 | 2008-06-07 03:54:59 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=* |
| 64.124.85.78 | 2008-06-07 04:03:05 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt |
| 64.124.85.78 | 2008-06-07 04:03:37 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.124.85.78 | 2008-06-07 04:12:51 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 64.124.85.78 | 2008-06-07 04:14:23 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.124.85.78 | 2008-06-07 04:22:07 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.13.160.30 | 2008-06-07 10:32:00 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.13.160.30 | 2008-06-07 10:38:04 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 81.31.47.2 | 2008-06-07 20:49:59 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.oriolmanya.net%2Fnautilus%2FphpBB2%2Flanguage%2Flang_english%2Fifekeri%2Fcekogah%2F |
| 81.31.47.2 | 2008-06-07 20:50:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.obrasmecanicasch.com%2Fomch%2Fimg%2Fanawuho%2Fohuhiru%2F |
| 81.31.47.2 | 2008-06-07 20:50:00 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.heaven-house.kz%2Ftemplates_c%2Fomoj%2Fedexuq%2F |
| 81.31.47.2 | 2008-06-07 20:50:19 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.39.234.5 | 2008-06-09 10:20:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 59.180.130.114 | 2008-06-10 12:09:09 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 59.180.130.114 | 2008-06-10 12:09:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.159 | 2008-06-10 14:49:32 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-11 06:16:39 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.153 | 2008-06-12 21:09:22 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.210.156 | 2008-06-13 05:56:46 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.154 | 2008-06-13 20:32:19 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-06-13 22:35:56 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-06-14 00:55:58 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-06-14 08:20:24 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.143 | 2008-06-15 00:45:14 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-06-15 00:45:17 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 72.44.50.247 | 2008-06-15 07:28:07 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt |
| 72.44.50.247 | 2008-06-15 07:29:03 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.44.50.247 | 2008-06-15 07:29:14 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=msnbot |
| 72.44.50.247 | 2008-06-15 07:30:48 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Slurp |
| 72.44.50.247 | 2008-06-15 07:31:00 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=* |
| 72.44.50.247 | 2008-06-15 07:31:09 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.44.50.247 | 2008-06-15 07:31:38 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 72.44.50.247 | 2008-06-15 07:33:15 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Teoma |
| 72.44.50.247 | 2008-06-15 07:33:43 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 72.44.50.247 | 2008-06-15 07:34:05 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.210.152 | 2008-06-15 19:25:20 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.124.85.78 | 2008-06-16 04:20:33 | 200-OK | Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.35.223.153 | 2008-06-16 19:40:15 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 65.55.104.215 | 2008-06-17 12:01:32 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.104.215 | 2008-06-17 12:02:04 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.104.215 | 2008-06-17 12:02:30 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.104.215 | 2008-06-17 12:03:15 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 65.55.104.215 | 2008-06-17 12:16:01 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.104.215 | 2008-06-17 12:20:09 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.104.215 | 2008-06-17 12:24:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.104.215 | 2008-06-17 12:24:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.104.215 | 2008-06-17 12:25:19 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 69.73.187.68 | 2008-06-17 17:15:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fhonamfishing.co.kr%2Fphpmysqladmin%2Flibraries%2Fnov%2Fuyowuwi%2F |
| 69.73.187.68 | 2008-06-17 17:15:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.qubestunes.com%2Ftreytest%2F1%2Fadoyuru%2Falameja%2F |
| 69.73.187.68 | 2008-06-17 17:15:36 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.clubnataciotortosa.com%2FUserFiles%2FFile%2Fedut%2Fade%2F |
| 69.73.187.68 | 2008-06-17 17:15:50 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 91.121.90.170 | 2008-06-17 21:42:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.landi-sempach-emmen.ch%2Faktionen%2Fimage%2Fzafecez%2Froxovef%2F |
| 91.121.90.170 | 2008-06-17 21:42:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.cusianagas.com%2Fadministrador%2Fciw%2Fasezu%2F |
| 91.121.90.170 | 2008-06-17 21:42:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=http%3A%2F%2Fwww.boomerbible.com%2Finstapunk%2FMType%2Farchives%2Fajuq%2Favu%2F |
| 91.121.90.170 | 2008-06-17 21:43:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) | /repstuff/robots.txt?crawlerName=msnbot |
| 70.167.71.3 | 2008-06-18 06:57:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 70.167.71.3 | 2008-06-18 06:58:01 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 70.167.71.3 | 2008-06-18 06:58:21 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 70.167.71.3 | 2008-06-18 06:58:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 216.243.81.253 | 2008-06-18 14:11:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 216.243.81.253 | 2008-06-18 14:12:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-18 21:22:24 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-18 21:31:39 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.13.160.30 | 2008-06-18 21:32:10 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Teoma |
| 64.13.160.30 | 2008-06-19 05:30:26 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=msnbot |
| 64.13.160.30 | 2008-06-19 05:33:49 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 64.13.160.30 | 2008-06-19 05:39:26 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.104.166 | 2008-06-19 07:44:56 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 121.14.96.152 | 2008-06-19 10:35:46 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt |
| 58.60.13.231 | 2008-06-19 10:35:48 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=* |
| 58.60.14.236 | 2008-06-19 10:36:04 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 58.60.14.236 | 2008-06-19 10:36:26 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot |
| 58.60.14.231 | 2008-06-19 10:36:33 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Slurp |
| 121.14.96.153 | 2008-06-19 10:36:39 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 121.14.96.153 | 2008-06-19 10:36:48 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 58.60.13.231 | 2008-06-19 10:36:51 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 121.14.96.153 | 2008-06-19 10:37:02 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=Teoma |
| 121.14.96.152 | 2008-06-19 10:37:12 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0) | /repstuff/robots.txt?crawlerName=msnbot |
| 72.194.216.154 | 2008-06-19 18:18:28 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_4_11; en) AppleWebKit/526+ (KHTML, like Gecko) Version/3.0.4 Safari/523.12.2 | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-19 20:06:03 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 74.75.234.120 | 2008-06-19 22:04:33 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; AIRF; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 74.75.234.120 | 2008-06-19 22:05:23 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; AIRF; .NET CLR 2.0.50727) | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-19 23:52:26 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Slurp |
| 206.47.26.120 | 2008-06-20 08:47:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt |
| 206.47.26.120 | 2008-06-20 08:47:53 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 206.47.26.120 | 2008-06-20 08:48:21 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648) | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-20 09:58:15 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.210.159 | 2008-06-20 17:19:40 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 99.245.234.171 | 2008-06-20 22:07:05 | 200-OK | Opera/9.02 (Windows NT 5.1; U; en) | /repstuff/robots.txt |
| 99.245.234.171 | 2008-06-20 22:08:17 | 200-OK | Opera/9.02 (Windows NT 5.1; U; en) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 68.191.201.2 | 2008-06-21 04:08:01 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 64.13.160.30 | 2008-06-21 23:55:09 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.13.160.30 | 2008-06-21 23:57:54 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-21 23:59:34 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot |
| 64.13.160.30 | 2008-06-22 05:23:38 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt |
| 75.118.190.61 | 2008-06-22 14:14:36 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.14) Gecko/20080416 Fedora/2.0.0.14-1.fc8 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 75.118.190.61 | 2008-06-22 14:14:58 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.14) Gecko/20080416 Fedora/2.0.0.14-1.fc8 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=* |
| 117.99.57.101 | 2008-06-22 15:10:22 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.153 | 2008-06-22 23:19:06 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.210.156 | 2008-06-23 09:12:55 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 64.13.160.30 | 2008-06-23 14:53:35 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.154 | 2008-06-24 00:50:47 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.149 | 2008-06-24 03:15:44 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.150 | 2008-06-24 03:17:39 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.44.50.247 | 2008-06-24 10:21:36 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=msnbot |
| 72.44.50.247 | 2008-06-24 10:22:54 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=* |
| 72.44.50.247 | 2008-06-24 10:23:05 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.44.50.247 | 2008-06-24 10:23:28 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Teoma |
| 72.44.50.247 | 2008-06-24 10:23:54 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Slurp |
| 72.44.50.247 | 2008-06-24 10:24:06 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 72.44.50.247 | 2008-06-24 10:24:15 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.44.50.247 | 2008-06-24 10:24:23 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 72.44.50.247 | 2008-06-24 10:24:45 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 72.44.50.247 | 2008-06-24 10:24:54 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt |
| 65.55.210.158 | 2008-06-24 11:02:10 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 70.161.218.31 | 2008-06-24 11:41:29 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 70.161.218.31 | 2008-06-24 11:41:36 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 70.161.218.31 | 2008-06-24 11:41:51 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Slurp |
| 70.161.218.31 | 2008-06-24 11:41:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Googlebot |
| 70.161.218.31 | 2008-06-24 11:42:02 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=Teoma |
| 66.27.61.154 | 2008-06-24 16:11:39 | 200-OK | Googlebot/2.1 (+http://www.google.com/bot.html) | /repstuff/robots.txt |
| 66.27.61.154 | 2008-06-24 16:12:12 | 200-OK | Googlebot/2.1 (+http://www.google.com/bot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 66.27.61.154 | 2008-06-24 17:07:12 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 66.27.61.154 | 2008-06-24 21:42:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 131.107.65.118 | 2008-06-24 23:30:38 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt |
| 131.107.65.118 | 2008-06-24 23:30:43 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Googlebot |
| 131.107.65.118 | 2008-06-24 23:30:47 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 131.107.65.118 | 2008-06-24 23:30:49 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 131.107.65.118 | 2008-06-24 23:30:54 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 131.107.65.118 | 2008-06-24 23:30:56 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 131.107.65.118 | 2008-06-24 23:30:59 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Slurp |
| 131.107.65.118 | 2008-06-24 23:31:01 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=msnbot |
| 131.107.65.118 | 2008-06-24 23:31:03 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=Teoma |
| 131.107.65.118 | 2008-06-24 23:31:05 | 200-OK | MSRBOT (http://research.microsoft.com/research/sv/msrbot/ | /repstuff/robots.txt?crawlerName=* |
| 64.13.160.30 | 2008-06-25 01:18:05 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 64.13.160.30 | 2008-06-25 01:47:43 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.143 | 2008-06-25 03:21:41 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-06-25 03:22:38 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 68.191.201.2 | 2008-06-25 12:49:15 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 65.55.210.152 | 2008-06-26 00:37:14 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 208.96.54.68 | 2008-06-26 02:49:13 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt |
| 155.91.64.10 | 2008-06-26 06:51:07 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt |
| 155.91.64.10 | 2008-06-26 06:51:18 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 155.91.64.10 | 2008-06-26 06:51:27 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) | /repstuff/robots.txt?crawlerName=* |
| 195.84.66.212 | 2008-06-26 07:53:28 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; sv-SE; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt |
| 195.84.66.212 | 2008-06-26 07:53:43 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; sv-SE; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 195.84.66.212 | 2008-06-26 07:53:49 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; sv-SE; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.68 | 2008-06-26 08:17:40 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=* |
| 208.96.54.68 | 2008-06-26 09:14:03 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Slurp |
| 208.96.54.68 | 2008-06-26 09:14:51 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Teoma |
| 208.96.54.68 | 2008-06-26 09:32:21 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=msnbot |
| 208.96.54.68 | 2008-06-26 10:13:10 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot |
| 208.96.54.68 | 2008-06-26 11:03:42 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 208.96.54.68 | 2008-06-26 11:22:10 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 208.96.54.68 | 2008-06-26 11:34:16 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 208.96.54.68 | 2008-06-26 12:01:11 | 200-OK | Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 221.47.248.32 | 2008-06-29 02:33:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt |
| 221.47.248.32 | 2008-06-29 02:34:04 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14 | /repstuff/robots.txt?crawlerName=msnbot |
| 64.13.160.30 | 2008-06-29 12:36:17 | 200-OK | Mozilla/5.0 (compatible; ScoutJet; +http://www.scoutjet.com/) | /repstuff/robots.txt?crawlerName=msnbot |
| 209.234.171.43 | 2008-06-29 13:37:34 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=* |
| 209.234.171.43 | 2008-06-29 13:37:40 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 209.234.171.43 | 2008-06-29 13:37:45 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot |
| 209.234.171.43 | 2008-06-29 13:37:50 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 209.234.171.43 | 2008-06-29 13:37:55 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 209.234.171.43 | 2008-06-29 13:38:00 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 209.234.171.43 | 2008-06-29 13:38:05 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Slurp |
| 209.234.171.43 | 2008-06-29 13:38:11 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=Teoma |
| 209.234.171.43 | 2008-06-29 13:38:16 | 200-OK | ia_archiver | /repstuff/robots.txt?crawlerName=msnbot |
| 68.191.201.2 | 2008-06-29 15:16:42 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT; MS Search 4.0 Robot) | /repstuff/robots.txt |
| 209.234.171.43 | 2008-06-29 18:15:48 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 209.234.171.43 | 2008-06-29 18:15:53 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 63.231.237.209 | 2008-06-30 06:11:25 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 63.231.237.209 | 2008-06-30 06:11:41 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 63.231.237.209 | 2008-06-30 06:11:43 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Slurp |
| 63.231.237.209 | 2008-06-30 06:11:45 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=msnbot |
| 63.231.237.209 | 2008-06-30 06:12:11 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=* |
| 60.33.130.49 | 2008-07-01 21:58:18 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 6.0; ja; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=* |
| 150.70.84.179 | 2008-07-01 22:03:08 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) | /repstuff/robots.txt?crawlerName=* |
| 209.234.171.43 | 2008-07-01 22:57:03 | 200-OK | ia_archiver | /repstuff/robots.txt? |
| 209.234.171.43 | 2008-07-01 22:57:22 | 200-OK | ia_archiver | /repstuff/robots.txt |
| 71.70.226.96 | 2008-07-02 09:34:37 | 200-OK | Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9) Gecko/2008061017 Firefox/3.0 | /repstuff/robots.txt |
| 71.70.226.96 | 2008-07-02 09:34:45 | 200-OK | Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9) Gecko/2008061017 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Googlebot |
| 71.70.226.96 | 2008-07-02 09:35:37 | 200-OK | Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9) Gecko/2008061017 Firefox/3.0 | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.153 | 2008-07-03 01:33:06 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.230.219 | 2008-07-03 03:23:30 | 200-OK | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.230.219 | 2008-07-03 03:23:33 | 200-OK | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 72.189.242.37 | 2008-07-03 04:11:22 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727; InfoPath.1; .NET CLR.3.0.04131.06; OfficeLiveConnector.1.0; IEMB3) | /repstuff/robots.txt |
| 72.189.242.37 | 2008-07-03 04:20:27 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727; InfoPath.1; .NET CLR.3.0.04131.06; OfficeLiveConnector.1.0; IEMB3) | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.189.242.37 | 2008-07-03 04:20:55 | 200-OK | Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0; .NET CLR 2.0.50727; InfoPath.1; .NET CLR.3.0.04131.06; OfficeLiveConnector.1.0; IEMB3) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.230.226 | 2008-07-03 07:02:27 | 200-OK | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 65.55.230.226 | 2008-07-03 07:02:31 | 200-OK | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.230.226 | 2008-07-03 07:02:31 | 200-OK | msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.156 | 2008-07-03 11:22:53 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 200.96.99.194 | 2008-07-03 12:39:35 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; pt-BR; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt |
| 84.66.52.190 | 2008-07-03 15:45:20 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt |
| 84.66.52.190 | 2008-07-03 15:45:36 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt?crawlerName=Googlebot |
| 84.66.52.190 | 2008-07-03 15:45:51 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.154 | 2008-07-04 03:14:51 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.150 | 2008-07-04 04:56:04 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.149 | 2008-07-04 06:21:02 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 65.55.210.158 | 2008-07-04 15:25:46 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 64.62.142.170 | 2008-07-04 16:21:43 | 200-OK | Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-07-05 06:07:00 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-07-05 06:07:02 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 65.55.210.152 | 2008-07-06 03:19:49 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 60.240.249.194 | 2008-07-08 02:16:44 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 | //repstuff/robots.txt |
| 208.223.208.181 | 2008-07-09 23:09:49 | 200-OK | Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-07-10 18:44:44 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 77.91.224.4 | 2008-07-10 18:47:13 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 77.91.224.4 | 2008-07-10 18:49:23 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 77.91.224.4 | 2008-07-10 18:51:37 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 77.91.224.4 | 2008-07-10 18:53:47 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 77.91.224.4 | 2008-07-10 18:56:04 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 77.91.224.4 | 2008-07-10 18:58:36 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.91.224.4 | 2008-07-10 19:01:31 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.91.224.4 | 2008-07-10 19:04:56 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 77.91.224.4 | 2008-07-10 19:08:11 | 200-OK | WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 60.240.249.194 | 2008-07-10 19:13:47 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 | //repstuff/robots.txt |
| 85.17.173.8 | 2008-07-10 23:05:31 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt |
| 85.17.173.8 | 2008-07-10 23:05:32 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot |
| 85.17.173.8 | 2008-07-10 23:05:33 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 85.17.173.8 | 2008-07-10 23:05:33 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 85.17.173.8 | 2008-07-10 23:05:33 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 85.17.173.8 | 2008-07-10 23:05:34 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 85.17.173.8 | 2008-07-10 23:05:34 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Slurp |
| 85.17.173.8 | 2008-07-10 23:05:35 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=msnbot |
| 85.17.173.8 | 2008-07-10 23:05:37 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=Teoma |
| 85.17.173.8 | 2008-07-10 23:05:37 | 200-OK | WebAlta Crawler/1.3.34 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.159 | 2008-07-12 01:20:52 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=* |
| 72.44.50.247 | 2008-07-12 09:39:26 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt |
| 72.44.50.247 | 2008-07-12 09:39:43 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Slurp |
| 72.44.50.247 | 2008-07-12 09:40:51 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 72.44.50.247 | 2008-07-12 09:41:05 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 72.44.50.247 | 2008-07-12 09:41:14 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=* |
| 72.44.50.247 | 2008-07-12 09:41:28 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 72.44.50.247 | 2008-07-12 09:42:00 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 72.44.50.247 | 2008-07-12 09:42:36 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Googlebot |
| 72.44.50.247 | 2008-07-12 09:42:48 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=msnbot |
| 72.44.50.247 | 2008-07-12 09:43:00 | 200-OK | Mozilla/5.0 (compatible; zermelo; +http://www.powerset.com) [email:paul@page-store.com,crawl@powerset.com] | /repstuff/robots.txt?crawlerName=Teoma |
| 60.240.249.194 | 2008-07-12 13:51:15 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 | //repstuff/robots.txt |
| 65.55.210.152 | 2008-07-13 03:25:47 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=msnbot |
| 65.55.210.156 | 2008-07-13 12:50:32 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Slurp |
| 65.55.210.150 | 2008-07-14 06:20:36 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.153 | 2008-07-14 06:26:28 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot |
| 65.55.210.149 | 2008-07-14 09:13:59 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Mobile |
| 203.152.96.249 | 2008-07-14 14:23:55 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt |
| 203.152.96.249 | 2008-07-14 14:24:05 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt?crawlerName=Googlebot |
| 203.152.96.249 | 2008-07-14 14:24:12 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.15) Gecko/20080623 Firefox/2.0.0.15 | /repstuff/robots.txt?crawlerName=* |
| 65.55.210.158 | 2008-07-14 17:38:47 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 60.240.249.195 | 2008-07-14 21:45:49 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.0.4 | //repstuff/robots.txt |
| 213.123.186.247 | 2008-07-15 02:35:48 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 213.123.186.247 | 2008-07-15 02:35:58 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9) Gecko/2008052906 Firefox/3.0 | /repstuff/robots.txt?crawlerName=Mediapartners-Google |
| 65.55.210.143 | 2008-07-15 08:45:46 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt |
| 65.55.210.143 | 2008-07-15 08:45:47 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Teoma |
| 71.238.140.80 | 2008-07-16 05:07:19 | 200-OK | Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9) Gecko/2008061004 Firefox/3.0 | /repstuff/robots.txt |
| 65.55.210.152 | 2008-07-16 06:45:52 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/robots.txt?crawlerName=Googlebot-Image |
| 88.107.142.203 | 2008-07-17 14:31:42 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16 | /repstuff/robots.txt |
| 88.107.142.203 | 2008-07-17 14:31:59 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16 | /repstuff/robots.txt?crawlerName=Adsbot-Google |
| 88.107.142.203 | 2008-07-17 14:32:18 | 200-OK | Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.16) Gecko/20080702 Firefox/2.0.0.16 | /repstuff/robots.txt?crawlerName=* |
| 77.88.26.26 | 2008-07-17 15:04:25 | 200-OK | Yandex/1.01.001 (compatible; Win16; I) | /repstuff/robots.txt?crawlerName=msnbot |
| 77.88.26.26 | 2008-07-17 15:04:46 | 200-OK | Yandex/1.01.001 (compatible; Win16; I) | /repstuff/robots.txt?crawlerName=Slurp |
| 77.88.26.26 | 2008-07-17 15:06:07 | 200-OK | Yandex/1.01.001 (compatible; Win16; I) | /repstuff/robots.txt |
| 60.240.249.194 | 2008-07-17 19:57:42 | 200-OK | Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.4) |