duplicate content

Hello

Vivvo is great, i love it, however i have a question.
The articels come with print pages and plain text pages, which is great.

Is there an easy way to change where these pages are published so i can hide them from google so my articles are not seen as duplicate content?

any help would be great

thanks

Dave

[shketuljko]

You need to use robots.txt

Useful links:
http://www.robotstxt.org/robotstxt.html
http://www.webmasterworld.com/robots_txt/3245173.htm

[Dugi]

now that you mentioned it i have no idea why this is not included in vivvo's htaccess as standard seeing that it's a must for most websites.

creating a robots.txt file will not work without editing your htaccess file first so here it is.

even if you have robots.txt in your root directory no one will be able to see it and you will get your 404 page if you try to access it.

solution:
Add this line to you htaccess file

RewriteRule ^robots.txt$ robots.txt [L]

then in robots.txt add this (if you want to stop search engines from indexing your print pages

User-agent: *
disallow: /*.html?print$

Hope that helps

Hello

User-agent: *
disallow: /*.html?print$

are you sure this will not effect your .html pages as well and being not indexed ?!

[Dugi]

don't know you tell me
it works well on my sites

maybe someone who knows more about robots/htaccess can confirm/deny that my example above works

[shketuljko]

... and for txt files:

Disallow: /*.txt$

Hello everyone, thanks for the responses to this, I will go about doing this.
Thanks for your time :-)

[bobster65]

Originally Posted by v!vv0

Hello

are you sure this will not effect your .html pages as well and being not indexed ?!

yes, it will NOT effect .html pages ... its easy to test this out with google webmaster tools ..

Are you guys sure it works?

I have tried it on my website and its not working. Google is still indexing .txt and print files..which is causing google to to think I am puting duplicate content and is being penalized by it..

Any help from someone?

Regards
Ajeet

[Alex]

What exactly did you try, can you paste the robots.txt here?

Did you try this:

User-agent: *
Disallow: /*.txt$
Disallow: /*?print$