This page tests an experimental robots.txt directive:
"Noindex: /repstuff/noindex-nofollow.php
Nofollow: /repstuff/noindex-nofollow.php"

Below is a list of search engine crawlers from Google, Yahoo, MSN and Ask which requested it. The working theory is, that all crawlers except Ms. Googlebot ignore the robots.txt statement above. Whether the possibly crawled page passed the indexer or not can be checked by requesting Google's cache of this page. Whether a page linked from here made it in the search index or not reveals this link to Google's cached page copy. Perhaps all this leads to nothing but fun. We'll see. Here is the log file:

IP Address TimeStamp Response UserAgent Requested URI
Faked 2007-11-21 00:00:01 200-OK Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) /repstuff/noindex-nofollow.php
Faked 2007-11-21 00:00:01 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
Faked 2007-11-21 00:00:01 200-OK Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) /repstuff/noindex-nofollow.php
Faked 2007-11-21 00:00:01 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
Faked 2007-11-21 00:00:01 200-OK Googlebot/2.1 (+http://www.google.com/bot.html) /repstuff/noindex-nofollow.php
66.249.72.209 2007-11-21 14:39:30 200-OK Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) /repstuff/noindex-nofollow.php
74.6.19.226 2007-11-21 15:15:31 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.212.244 2007-11-26 08:18:59 200-OK msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
65.55.209.148 2007-11-27 21:25:43 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.19.226 2007-11-28 15:17:21 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2007-11-29 23:57:30 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.19.226 2007-12-05 16:51:32 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2007-12-12 16:53:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2007-12-20 02:48:02 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.136 2007-12-26 16:17:12 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2007-12-27 02:51:36 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.126 2008-01-01 01:50:30 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-01 05:40:46 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-02 11:57:22 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.136 2008-01-03 04:15:12 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-03 13:55:15 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.122 2008-01-04 04:38:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-04 14:07:04 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-05 00:56:07 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.122 2008-01-05 05:58:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-05 19:30:45 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.122 2008-01-06 06:07:56 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-01-06 08:54:13 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-06 21:58:43 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-06 22:42:55 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-07 00:08:04 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-07 01:41:13 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.122 2008-01-07 06:57:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-08 01:03:06 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-08 12:38:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-09 01:46:38 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-09 19:13:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-10 02:59:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-10 11:34:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-10 20:38:09 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.212.244 2008-01-11 01:18:26 200-OK msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-11 03:52:14 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-12 04:42:20 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-15 16:12:51 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-21 02:17:14 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-23 00:47:25 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-23 07:16:49 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-24 03:26:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-01-24 22:28:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-25 04:17:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-01-25 22:53:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-26 06:35:33 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-26 07:38:01 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-01-26 22:57:42 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-27 07:53:45 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-01-28 00:30:40 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-28 04:40:14 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-28 10:15:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-01-28 23:26:06 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-29 09:05:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-29 11:44:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-30 07:45:50 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-30 09:08:04 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.140 2008-01-30 12:26:41 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-01-31 09:49:52 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-01-31 10:07:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-01-31 16:20:41 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.22.136 2008-02-01 01:20:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.136 2008-02-01 01:21:20 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-01 10:50:51 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-02 12:51:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-02 17:44:02 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-02-02 22:51:41 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-03 12:53:23 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-03 18:29:06 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-04 20:52:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-05 12:56:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-08 13:15:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-09 10:56:39 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-10 15:06:41 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-10 22:41:08 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-11 17:05:21 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-11 23:42:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-12 09:49:53 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-12 19:33:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-13 01:43:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-13 12:58:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-13 19:38:30 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-14 23:09:21 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-15 15:51:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-16 08:51:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-17 14:37:07 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-18 16:13:37 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-19 01:10:31 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-19 20:19:33 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-02-20 02:42:06 200-OK msnbot/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.8.118 2008-02-20 10:48:55 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-20 22:27:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-02-22 03:03:45 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-02-22 16:10:22 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-22 17:26:12 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-23 20:49:53 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-25 00:01:21 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-02-26 00:52:44 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.8.81 2008-02-28 03:12:35 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-03-01 09:56:46 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-02 07:57:53 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-03-02 10:00:23 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-03 08:07:57 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-04 09:19:46 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.19.226 2008-03-04 10:09:01 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-05 22:38:55 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.8.102 2008-03-06 03:46:01 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.214.45.101 2008-03-06 17:01:01 200-OK Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-07 19:45:41 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-08 03:08:56 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-03-08 05:32:17 200-OK msnbot/1.1 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-09 05:10:30 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.58.171 2008-03-09 08:16:25 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-09 21:33:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-10 06:04:43 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-11 10:48:50 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-11 21:47:04 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-14 09:07:12 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-14 22:02:06 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-16 04:11:01 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-17 06:15:39 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-03-18 07:08:18 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-20 23:54:37 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-24 15:37:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-03-26 04:56:35 200-OK msnbot/1.1 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
67.195.44.75 2008-03-27 07:54:22 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-03-28 09:54:37 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-28 13:17:19 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-03-29 11:08:44 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-29 13:18:53 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-03-30 13:20:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.44.75 2008-03-30 14:12:54 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.54.89 2008-04-01 12:50:17 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-04-01 13:25:41 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-04-02 09:41:35 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-04-04 13:32:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-04 17:42:38 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-04-05 13:34:00 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-06 01:37:37 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.20.151 2008-04-07 13:39:56 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-04-08 07:26:31 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-09 02:40:35 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-04-09 09:42:51 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.99 2008-04-09 09:55:47 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.166 2008-04-10 14:30:06 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-11 05:52:43 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.209.148 2008-04-12 08:28:28 200-OK msnbot/1.1 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-12 18:21:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-14 18:56:07 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-15 12:59:13 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-04-16 09:42:53 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-17 19:06:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-18 16:09:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
65.55.212.242 2008-04-19 13:20:00 200-OK msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-21 06:36:42 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-21 14:43:38 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-04-21 22:41:13 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-22 13:17:15 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-22 20:42:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-04-23 01:49:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-04-23 09:47:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-04-24 04:56:36 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-04-25 11:56:07 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-26 03:41:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-27 08:30:45 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-29 05:30:19 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-29 13:26:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-04-29 17:25:48 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-04-30 09:00:10 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-04-30 10:10:31 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-05-01 20:33:49 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-05-03 00:12:58 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-05-03 11:07:16 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-05-04 04:56:33 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-05-04 11:11:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.91 2008-05-05 17:22:44 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-05-06 13:35:05 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.115 2008-05-06 13:43:19 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.115 2008-05-06 21:47:49 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-07 06:32:35 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-05-07 10:15:34 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-08 06:51:40 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.115 2008-05-08 07:14:44 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-09 09:07:11 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-05-09 13:46:00 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-10 09:27:56 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-11 20:09:21 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.87.100 2008-05-12 16:32:15 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-13 01:32:14 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
74.6.22.34 2008-05-13 07:48:55 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.37.115 2008-05-13 13:47:41 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
72.30.216.96 2008-05-14 06:03:59 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php
67.195.51.121 2008-05-14 10:17:27 200-OK Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) /repstuff/noindex-nofollow.php

The first five entries are samples. An empty table wouldn't look nice.