Maybe you saw my post about my problem to exclude the feed from the search result pages. To avoid duplicate content I wanted to exclude the feeds from the content, so they can not draw any attention from the actual blog post. Finally I found out why Google had denied my request and fixed that problem (I had made a mistake in the robots.txt). But there was an additional problem: what about the comment feeds?

I could exclude those feeds by including

disallow */feed/

but the as I have learned the robots.txt just prevents the search robots to spider a file, but it does not prevent it from showing up in the SERPs, when someone is linking to you. Therefore a

noindex

can help. I finally found the Wordpress plugin “Don’t index my feed” which adds code to each feed to prevent the robots from indexing the files. Let’s see how this works.

You might want to read the following posts as well:

This post has no comment.

Clicky Web Analytics