Comments on: No more RSS feeds in Google’s search results http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/ If you've read my articles somewhere on the Internet, expect something different here. Thu, 02 Sep 2010 11:51:46 +0000 http://wordpress.org/?v=2.2.3 By: Don’t Block Your RSS Feeds - Pocket SEO http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-941 Don’t Block Your RSS Feeds - Pocket SEO Tue, 08 Jan 2008 04:15:07 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-941 [...] recently said that they are going to stop indexing RSS feeds (first seen here), but I’ve still seen RSS feeds in the search results as recently as a few days [...] […] recently said that they are going to stop indexing RSS feeds (first seen here), but I’ve still seen RSS feeds in the search results as recently as a few days […]

]]> By: Search Engine Land: News About Search Engines & Search Marketing http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-843 Search Engine Land: News About Search Engines & Search Marketing Tue, 18 Dec 2007 18:10:43 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-843 <strong>SearchCap: The Day In Search, December 18, 2007...</strong> Below is what happened in search today, as reported on Search Engine Land and from other places across the web....... SearchCap: The Day In Search, December 18, 2007…

Below is what happened in search today, as reported on Search Engine Land and from other places across the web…….

]]> By: SEO Canada http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-842 SEO Canada Tue, 18 Dec 2007 14:50:27 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-842 Now if only they would remove Wiki from the SERPs, things just might be perfect :) Now if only they would remove Wiki from the SERPs, things just might be perfect :)

]]> By: JLH http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-839 JLH Tue, 18 Dec 2007 13:06:36 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-839 I blocked and nofollowed mine just because I hate seeing a search result for something, click on it, only to find out its a feed. I didn't want that to happen to my visitors. Actually Matt Cutts blog is what inspired me to do it, often I use Google to search his site to find something I thought I remember him writing about only to hit a feed. I'm glad they made a move on it. Since my German is about as good as well, any other language than English (I know, I'm an ugly American)thanks for pointing this out. I blocked and nofollowed mine just because I hate seeing a search result for something, click on it, only to find out its a feed. I didn’t want that to happen to my visitors. Actually Matt Cutts blog is what inspired me to do it, often I use Google to search his site to find something I thought I remember him writing about only to hit a feed. I’m glad they made a move on it. Since my German is about as good as well, any other language than English (I know, I’m an ugly American)thanks for pointing this out.

]]> By: Sebastian http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-838 Sebastian Tue, 18 Dec 2007 10:51:18 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-838 Don't mix up Feedfetcher and Googlebot. Feedfetcher doesn't obey robots.txt, hence it's worthless to add a Feedfetcher section. Don’t mix up Feedfetcher and Googlebot. Feedfetcher doesn’t obey robots.txt, hence it’s worthless to add a Feedfetcher section.

]]> By: Igor The Troll http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-837 Igor The Troll Tue, 18 Dec 2007 10:35:12 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-837 Thanks. Actually Googlebot has nothing to do with feeds, so might as well disallow him and rel="nofollow" to him. Here is one back @You http://blogsearch.google.com/ping Thanks. Actually Googlebot has nothing to do with feeds, so might as well disallow him and rel=”nofollow” to him.

Here is one back @You
http://blogsearch.google.com/ping

]]> By: Sebastian http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-836 Sebastian Tue, 18 Dec 2007 10:24:21 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-836 Igor, your shouldn't block your feeds in robots.txt, but rel-nofollow on-page links to them. If you really want to block them in robots.txt, then try something like User-agent: Googlebot # block RSS feeds: Disallow: */feed$ Disallow: */feed$ # block totally and utterly useless archives # (provided your permalink URIs don't begin with the year): Disallow: /2007 Disallow: /2008 Igor, your shouldn’t block your feeds in robots.txt, but rel-nofollow on-page links to them.

If you really want to block them in robots.txt, then try something like

User-agent: Googlebot
# block RSS feeds:
Disallow: */feed$
Disallow: */feed$
# block totally and utterly useless archives
# (provided your permalink URIs don’t begin with the year):
Disallow: /2007
Disallow: /2008

]]> By: Sebastian http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-835 Sebastian Tue, 18 Dec 2007 10:09:21 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-835 Michael, other than Technorati Google Blog Search concentrates on the feeds (that doesn't mean they ignore the surrounding stuff, blogrolls and such). Those feed URLs can be gathered from ping services and auto-discovery links in the HEAD section. Google blog search doesn't need on-page links to feeds to discover and process them. As for crawling, you could submit your RSS feeds as sitemaps to Google, Yahoo, and MSN, and add their URLs to your robots.txt for Ask. Feeds that are indexed but suppressed by the query engine are plain PageRank leaks, that's the sole reason to nofollow them. Michael, other than Technorati Google Blog Search concentrates on the feeds (that doesn’t mean they ignore the surrounding stuff, blogrolls and such). Those feed URLs can be gathered from ping services and auto-discovery links in the HEAD section. Google blog search doesn’t need on-page links to feeds to discover and process them.

As for crawling, you could submit your RSS feeds as sitemaps to Google, Yahoo, and MSN, and add their URLs to your robots.txt for Ask.

Feeds that are indexed but suppressed by the query engine are plain PageRank leaks, that’s the sole reason to nofollow them.

]]> By: Igor The Troll http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-834 Igor The Troll Tue, 18 Dec 2007 09:59:16 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-834 Great tip Sebastian, I am just getting my blog primed to go live and it was something I was conserned with. So I will disallow feeds in mo robot.txt but only for Googlebot. Probably Google has another spider for indexing feeds, do you know its name? I mean we do not want to leak PR to content that will not be indexed anyway. Maybe it maybe better to do a rel="nofollow" on the feeds as well, or only do rel="nofollow= I am just wondering why even bother leaving loose feeds to Googlebot if it will be removed. "We remove feeds from our search results!" To me this could mean they index them, and then remove them from the search results? So pertty much the question is which Google bot indexes feeds! Thank you, Igor Great tip Sebastian, I am just getting my blog primed to go live and it was something I was conserned with.

So I will disallow feeds in mo robot.txt but only for Googlebot. Probably Google has another spider for indexing feeds, do you know its name?

I mean we do not want to leak PR to content that will not be indexed anyway. Maybe it maybe better to do a rel=”nofollow” on the feeds as well, or only do rel=”nofollow= I am just wondering why even bother leaving loose feeds to Googlebot if it will be removed. “We remove feeds from our search results!” To me this could mean they index them, and then remove them from the search results?

So pertty much the question is which Google bot indexes feeds!

Thank you,
Igor

]]> By: Michael VanDeMar http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-833 Michael VanDeMar Tue, 18 Dec 2007 09:43:12 +0000 http://sebastians-pamphlets.com/google-to-remove-feeds-from-web-search-results/#comment-833 Sebastian, are you sure that nofollowing them is a good idea? I have a site that gets most of it's spidering done from Gbot following the news feed on it. And wouldn't that also impact Google Blog Search as well? Sebastian, are you sure that nofollowing them is a good idea? I have a site that gets most of it’s spidering done from Gbot following the news feed on it. And wouldn’t that also impact Google Blog Search as well?

]]>