Comments on: Getting URLs outta Google - the good, the popular, and the definitive way http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/ If you've read my articles somewhere on the Internet, expect something different here. Sat, 17 May 2008 11:36:26 +0000 http://wordpress.org/?v=2.2.3 By: Sebastian http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1097 Sebastian Thu, 31 Jan 2008 20:14:54 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1097 Thanks Melanie. :) Unfortunately, that's not a record. ;( I've spotted more than 10 issues from the list above, plus a few that I didn't mention, on e-commerce sites developed with ASP running on IIS.

Thanks Melanie. :) Unfortunately, that’s not a record. ;( I’ve spotted more than 10 issues from the list above, plus a few that I didn’t mention, on e-commerce sites developed with ASP running on IIS.

]]> By: Melanie Phung http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1093 Melanie Phung Thu, 31 Jan 2008 18:30:57 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1093 Thanks Sebastian - another good (and useful!) post. I worked on a site that committed 10 of the mistakes on your list (the first nine and then the last one). We did eventually fix most of it, but I'm wondering if that was a record or something. You ever seen a site that was guilty of more than 10 of those items all at once? Thanks Sebastian - another good (and useful!) post. I worked on a site that committed 10 of the mistakes on your list (the first nine and then the last one). We did eventually fix most of it, but I’m wondering if that was a record or something. You ever seen a site that was guilty of more than 10 of those items all at once?

]]> By: Google's Remove URLs Feature | Learning SEO Basics http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1052 Google's Remove URLs Feature | Learning SEO Basics Wed, 23 Jan 2008 06:27:03 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1052 [...] “If you want to remove stuff from search indexes permanently, not only Google’s, then you need to serve verified crawlers a forbidden response code (see how to deindex content).” [...] […] “If you want to remove stuff from search indexes permanently, not only Google’s, then you need to serve verified crawlers a forbidden response code (see how to deindex content).” […]

]]> By: karl http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1012 karl Thu, 17 Jan 2008 05:45:34 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-1012 My own solution for blocking bots and/or feedreaders. It's in French but the .htaccess file is easy to understand. :) <a href="http://www.la-grange.net/2008/01/03/bloquer-bots">Blocking Web robots by user agent string</a> Best [That works, but it's a kinda weak/risky approach - you don't cover spoofing and such. Sebastian] My own solution for blocking bots and/or feedreaders. It’s in French but the .htaccess file is easy to understand. :)

Blocking Web robots by user agent string

Best

[That works, but it’s a kinda weak/risky approach - you don’t cover spoofing and such. Sebastian]

]]> By: Do search engines index references to password protected smut? http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-990 Do search engines index references to password protected smut? Wed, 16 Jan 2008 14:42:26 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-990 [...] Matt Cutts said that Google doesn’t index password protected content. I wasn’t sure whether or not that [...] […] Matt Cutts said that Google doesn’t index password protected content. I wasn’t sure whether or not that […]

]]> By: Sebastian http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-989 Sebastian Wed, 16 Jan 2008 06:48:23 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-989 Thanks Vingold. :) I'm glad you consider my stuff helpful. Thanks Vingold. :) I’m glad you consider my stuff helpful.

]]> By: Sebastian http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-988 Sebastian Wed, 16 Jan 2008 06:47:09 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-988 Gab, you can trust Matt, consider him the co-author of this post (because I've stolen most of it from his video). Seriously, Matt's right and I've seen such references myself. Yahoo staff seldom comments here (in fact that happened only once), and the MSN dudes should hate me for my occasional rants as well, hence I don't expect that I'd get a statement from any search engine other than Google (Googlers are very responsive from my experience). You've a valid point, though. In the "popular way" section I've mixed quotes from Matt with my comments in a way that it's not clear who said what. That's another reason why I've embedded the video. Next time I scrape content I'll try to do a better job. Gab, you can trust Matt, consider him the co-author of this post (because I’ve stolen most of it from his video). Seriously, Matt’s right and I’ve seen such references myself. Yahoo staff seldom comments here (in fact that happened only once), and the MSN dudes should hate me for my occasional rants as well, hence I don’t expect that I’d get a statement from any search engine other than Google (Googlers are very responsive from my experience). You’ve a valid point, though. In the “popular way” section I’ve mixed quotes from Matt with my comments in a way that it’s not clear who said what. That’s another reason why I’ve embedded the video. Next time I scrape content I’ll try to do a better job.

]]> By: Gab "SEO ROI" Goldenberg http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-984 Gab "SEO ROI" Goldenberg Wed, 16 Jan 2008 01:39:32 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-984 Seb, you're the guy whose technical expertise I respect the most, and I think that goes for most people in search. So you're doing yourself a disservice with lines like these: "According to Matt Yahoo and MSN still list such URLs as references without snippets. Because only Google obeys “noindex” totally by wiping out even URL-only listings and foreign references, robots meta tags should be considered a kinda weak approach too." You're citing a Google engineer on Yahoo and MSN's algos. Then citing him again (at least, in context, it sounds that way) saying why Google is better. Even if it's true, it doesn't look good. At the very least there should be some response from Yahoo and MSN's reps, or else your own SERP analysis. My 2 cents. I still refer clients and leads to your stuff when I don't know the answer lol, so don't take that personally or anything ;). Seb, you’re the guy whose technical expertise I respect the most, and I think that goes for most people in search. So you’re doing yourself a disservice with lines like these:

“According to Matt Yahoo and MSN still list such URLs as references without snippets. Because only Google obeys “noindex” totally by wiping out even URL-only listings and foreign references, robots meta tags should be considered a kinda weak approach too.”

You’re citing a Google engineer on Yahoo and MSN’s algos. Then citing him again (at least, in context, it sounds that way) saying why Google is better. Even if it’s true, it doesn’t look good. At the very least there should be some response from Yahoo and MSN’s reps, or else your own SERP analysis.

My 2 cents. I still refer clients and leads to your stuff when I don’t know the answer lol, so don’t take that personally or anything ;).

]]> By: Vingold http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-982 Vingold Tue, 15 Jan 2008 23:35:17 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-982 This post specifically and this whole web site in general are quite the piece of work. Very well done. You sir are a skilled artisan. Masterful. This post specifically and this whole web site in general are quite the piece of work. Very well done. You sir are a skilled artisan. Masterful.

]]> By: Search Engine Land: News About Search Engines & Search Marketing http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-980 Search Engine Land: News About Search Engines & Search Marketing Tue, 15 Jan 2008 19:42:07 +0000 http://sebastians-pamphlets.com/getting-urls-out-of-google-the-good-popular-definitive-way/#comment-980 <strong>SearchCap: The Day In Search, January 15, 2008...</strong> Below is what happened in search today, as reported on Search Engine Land and from other places across the web....... SearchCap: The Day In Search, January 15, 2008…

Below is what happened in search today, as reported on Search Engine Land and from other places across the web…….

]]>