Below is a list of search engine crawlers from Google, Yahoo, MSN and Ask which requested it. The working theory is, that all crawlers except Ms. Googlebot ignore the robots.txt statement above. Whether the possibly crawled page passed the indexer or not can be checked by requesting Google's cache of this page. Whether a page linked from here made it in the search index or not reveals this link to Google's cached page copy. Perhaps all this leads to nothing but fun. We'll see. Here is the log file:
| IP Address | TimeStamp | Response | UserAgent | Requested URI |
| Faked | 2007-11-21 00:00:01 | 200-OK | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | /repstuff/noindex-nofollow.php |
| Faked | 2007-11-21 00:00:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| Faked | 2007-11-21 00:00:01 | 200-OK | Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) | /repstuff/noindex-nofollow.php |
| Faked | 2007-11-21 00:00:01 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| Faked | 2007-11-21 00:00:01 | 200-OK | Googlebot/2.1 (+http://www.google.com/bot.html) | /repstuff/noindex-nofollow.php |
| 66.249.72.209 | 2007-11-21 14:39:30 | 200-OK | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-11-21 15:15:31 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.212.244 | 2007-11-26 08:18:59 | 200-OK | msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2007-11-27 21:25:43 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-11-28 15:17:21 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2007-11-29 23:57:30 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-12-05 16:51:32 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-12-12 16:53:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-12-20 02:48:02 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.136 | 2007-12-26 16:17:12 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2007-12-27 02:51:36 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.126 | 2008-01-01 01:50:30 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-01 05:40:46 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-02 11:57:22 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.136 | 2008-01-03 04:15:12 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-03 13:55:15 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.122 | 2008-01-04 04:38:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-04 14:07:04 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-05 00:56:07 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.122 | 2008-01-05 05:58:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-05 19:30:45 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.122 | 2008-01-06 06:07:56 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-01-06 08:54:13 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-06 21:58:43 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-06 22:42:55 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-07 00:08:04 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-07 01:41:13 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.122 | 2008-01-07 06:57:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-08 01:03:06 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-08 12:38:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-09 01:46:38 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-09 19:13:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-10 02:59:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-10 11:34:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-10 20:38:09 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.212.244 | 2008-01-11 01:18:26 | 200-OK | msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-11 03:52:14 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-12 04:42:20 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-15 16:12:51 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-21 02:17:14 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-23 00:47:25 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-23 07:16:49 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-24 03:26:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-01-24 22:28:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-25 04:17:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-01-25 22:53:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-26 06:35:33 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-26 07:38:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-01-26 22:57:42 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-27 07:53:45 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-01-28 00:30:40 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-28 04:40:14 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-28 10:15:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-01-28 23:26:06 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-29 09:05:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-29 11:44:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-30 07:45:50 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-30 09:08:04 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.140 | 2008-01-30 12:26:41 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-01-31 09:49:52 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-01-31 10:07:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-01-31 16:20:41 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.22.136 | 2008-02-01 01:20:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.136 | 2008-02-01 01:21:20 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-01 10:50:51 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-02 12:51:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-02 17:44:02 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-02-02 22:51:41 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-03 12:53:23 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-03 18:29:06 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-04 20:52:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-05 12:56:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-08 13:15:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-09 10:56:39 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-10 15:06:41 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-10 22:41:08 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-11 17:05:21 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-11 23:42:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-12 09:49:53 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-12 19:33:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-13 01:43:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-13 12:58:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-13 19:38:30 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-14 23:09:21 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-15 15:51:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-16 08:51:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-17 14:37:07 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-18 16:13:37 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-19 01:10:31 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-19 20:19:33 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-02-20 02:42:06 | 200-OK | msnbot/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.8.118 | 2008-02-20 10:48:55 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-20 22:27:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-02-22 03:03:45 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-02-22 16:10:22 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-22 17:26:12 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-23 20:49:53 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-25 00:01:21 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-02-26 00:52:44 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.8.81 | 2008-02-28 03:12:35 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-03-01 09:56:46 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-02 07:57:53 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-03-02 10:00:23 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-03 08:07:57 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-04 09:19:46 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.19.226 | 2008-03-04 10:09:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-05 22:38:55 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.8.102 | 2008-03-06 03:46:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.214.45.101 | 2008-03-06 17:01:01 | 200-OK | Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-07 19:45:41 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-08 03:08:56 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-03-08 05:32:17 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-09 05:10:30 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.58.171 | 2008-03-09 08:16:25 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-09 21:33:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-10 06:04:43 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-11 10:48:50 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-11 21:47:04 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-14 09:07:12 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-14 22:02:06 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-16 04:11:01 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-17 06:15:39 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-03-18 07:08:18 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-20 23:54:37 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-24 15:37:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-03-26 04:56:35 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-03-27 07:54:22 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-03-28 09:54:37 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-28 13:17:19 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-03-29 11:08:44 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-29 13:18:53 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-03-30 13:20:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.44.75 | 2008-03-30 14:12:54 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.54.89 | 2008-04-01 12:50:17 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-04-01 13:25:41 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-04-02 09:41:35 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-04-04 13:32:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-04 17:42:38 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-04-05 13:34:00 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-06 01:37:37 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.20.151 | 2008-04-07 13:39:56 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-04-08 07:26:31 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-09 02:40:35 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-04-09 09:42:51 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.99 | 2008-04-09 09:55:47 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.166 | 2008-04-10 14:30:06 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-11 05:52:43 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.209.148 | 2008-04-12 08:28:28 | 200-OK | msnbot/1.1 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-12 18:21:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-14 18:56:07 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-15 12:59:13 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-04-16 09:42:53 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-17 19:06:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-18 16:09:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 65.55.212.242 | 2008-04-19 13:20:00 | 200-OK | msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-21 06:36:42 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-21 14:43:38 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-04-21 22:41:13 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-22 13:17:15 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-22 20:42:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-04-23 01:49:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-04-23 09:47:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-04-24 04:56:36 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-04-25 11:56:07 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-26 03:41:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-27 08:30:45 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-29 05:30:19 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-29 13:26:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-04-29 17:25:48 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-04-30 09:00:10 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-04-30 10:10:31 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-05-01 20:33:49 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-05-03 00:12:58 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-05-03 11:07:16 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-05-04 04:56:33 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-05-04 11:11:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.91 | 2008-05-05 17:22:44 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-05-06 13:35:05 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.115 | 2008-05-06 13:43:19 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.115 | 2008-05-06 21:47:49 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-07 06:32:35 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-05-07 10:15:34 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-08 06:51:40 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.115 | 2008-05-08 07:14:44 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-09 09:07:11 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-05-09 13:46:00 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-10 09:27:56 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-11 20:09:21 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.87.100 | 2008-05-12 16:32:15 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-13 01:32:14 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 74.6.22.34 | 2008-05-13 07:48:55 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.37.115 | 2008-05-13 13:47:41 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 72.30.216.96 | 2008-05-14 06:03:59 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
| 67.195.51.121 | 2008-05-14 10:17:27 | 200-OK | Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | /repstuff/noindex-nofollow.php |
The first five entries are samples. An empty table wouldn't look nice.