Maybe you saw my post about my problem to exclude the feed from the search result pages. To avoid duplicate content I wanted to exclude the feeds from the content, so they can not draw any attention from the actual blog post. Finally I found out why Google had denied my request and fixed that problem (I had made a mistake in the robots.txt). But there was an additional problem: what about the comment feeds?
I could exclude those feeds by including
disallow */feed/
but the as I have learned the robots.txt just prevents the search robots to spider a file, but it does not prevent it from showing up in the SERPs, when someone is linking to you. Therefore a
noindex
can help. I finally found the Wordpress plugin “Don’t index my feed” which adds code to each feed to prevent the robots from indexing the files. Let’s see how this works.
You might want to read the following posts as well:- Google Webmaster Tools: URL removal request denied!
- Wordpress Plugin: Digital Fingerprint
- Google penalty because of excluding the bot temporary by robots.txt?
- First month of Ubuntu 7.04 “Feisty Fawn” on FSC Amilo si 1520
- FSC si1520 and Ubuntu 7.04 “Feisty Fawn”
This post has no comment.