Comments on: Debugging robots.txt with Google Webmaster Tools http://sebastians-pamphlets.com/debugging-robots-txt-with-google-webmaster-tools/ If you've read my articles somewhere on the Internet, expect something different here. Mon, 21 May 2012 23:58:05 +0000 http://wordpress.org/?v=2.2.3 By: Bryan http://sebastians-pamphlets.com/debugging-robots-txt-with-google-webmaster-tools/#comment-1820 Bryan Sat, 03 Oct 2009 14:36:47 +0000 http://sebastians-pamphlets.com/debugging-robots-txt-with-google-webmaster-tools/#comment-1820 Learning how to use robots.txt also helps when it comes to SEO. You can disallow SEs from crawling some of your pages by using this one. Hope you can also make an article about htaccess. Thanks for the useful information. [You're not even following <a href="http://yourdailyguide.org/is-blog-commenting-a-good-strategy-to-earn-traffic/" rel="nofollow">your own advice</a> (" It is important that you leave good and meaningful comments because that’s what gonna get you clicks from the traffic") when it comes to blog comment spam. Do you really think dropping such a generic robots-txt-comment can pass the spam filter of a blog that provides <a href="http://sebastians-pamphlets.com/links/categories/?cat=robotstxt">tons</a> of posts dealing with the <a href="http://sebastians-pamphlets.com/links/categories/?cat=crawler-directives">REP</a>? By the way, I've an <a href="http://sebastians-pamphlets.com/links/categories/?cat=htaccess">.htaccess category</a>, too.] Learning how to use robots.txt also helps when it comes to SEO. You can disallow SEs from crawling some of your pages by using this one. Hope you can also make an article about htaccess. Thanks for the useful information.

[You’re not even following your own advice (” It is important that you leave good and meaningful comments because that’s what gonna get you clicks from the traffic”) when it comes to blog comment spam. Do you really think dropping such a generic robots-txt-comment can pass the spam filter of a blog that provides tons of posts dealing with the REP? By the way, I’ve an .htaccess category, too.]

]]> By: Michael Thomas http://sebastians-pamphlets.com/debugging-robots-txt-with-google-webmaster-tools/#comment-1748 Michael Thomas Fri, 21 Aug 2009 04:12:28 +0000 http://sebastians-pamphlets.com/debugging-robots-txt-with-google-webmaster-tools/#comment-1748 I noticed this the other day thank you for confirming some of the thoughts I had. I noticed this the other day thank you for confirming some of the thoughts I had.

]]>