No search, more fun: Netscape spamming Google

Google dislikes crawlable SERPs. But Google still indexes huge chunks of SERPs, and to make it worse, these disliked URLs sometimes rank above other useless webspam from Amazon, Ebay, and cohorts on the very first search result page.

For example Netscape is still flooding Google’s search index with crap as per the quality guidelines, which clearly state:

Use robots.txt to prevent crawling of search results pages […] that don’t add much value for users coming from search engines.

Netscape.com lacks a robots.txt, but how many patterns does it need to identify these pages as SERPs? Next search.netscape.com has a robots.txt, but it lacks a Disallow: / directive, respectively Disallow’s of all their scripts generating search results.

Is it that simple to get gazillions of useless autogenerated pages ranking at Google? Indeed. Following the Netscape precedent every assclown out there can buy a SE-script, can crawl the Web for a bunch of niche keywords, and will earn free Google traffic just because he has “forgotten” to upload a proper robots.txt file and Google isn’t capable of detecting SERPs. I mean when they don’t run a few tests with Netscape-SERPs, where’s the point of an unenforced no-crawlable-SERPs policy?

I just found another interesting snippet in Google’s quality guidelines:

If a site doesn’t meet our quality guidelines, it may be blocked from the index.

I certainly will not miss 1,360,000 URLs from a spamming site ;)



Share/bookmark this: del.icio.usGooglema.gnoliaMixxNetscaperedditSphinnSquidooStumbleUponYahoo MyWeb
Subscribe to      Entries Entries      Comments Comments      All Comments All Comments
 

3 Comments to "No search, more fun: Netscape spamming Google"

  1. Anonymous on 22 May, 2007  #link

    Check this one: http://www.google.com/search?q=site%3Asearch.netscape.com%2Fsearch&num=100 - Netscape is filling Google’s index with Google’s index. Tsk Tsk!

  2. TopRank on 25 May, 2007  #link

    Hey Sebastian, you made the BIGLIST of search engine marketing blogs over at Online Marketing Blog :)

    Congrats and thanks for the original content!

  3. Sebastian on 25 May, 2007  #link

    Thank you Lee! And thanks for the compliment :)

Leave a reply


[If you don't do the math, or the answer is wrong, you'd better have saved your comment before hitting submit. Here is why.]

Be nice and feel free to link out when a link adds value to your comment. More in my comment policy.