Google leave them pages well alone

[Scooby-Doo]

hi

 

Just another quicky...what is best way to tell google to leave certain pages alone, would it be through robots or can you do something in htaccess to stop googlebot indexing certain pages...or any other way???

 

Cheers

[QuickOldCar]

Can use robots.txt

 

some for instances, * will do pattern matching, the $ at end will be specific endings

 

User-agent: *

Disallow: /users/

Disallow: /images/

Disallow /print*/

Disallow: /*.pdf$

 

To not follow links on a page add this

<meta name="robots" content="nofollow" />

 

To not follow a specific page, add similar to this

<a href="links.html" rel="nofollow" />

 

May also use this in your http headers

X-Robots-Tag: noindex

[ignace]

<meta name="robots" content="nofollow">

 

Means the page will be indexed, to avoid this use:

<meta name="robots" content="noindex,nofollow">

[mrMarcus]

<meta name="robots" content="nofollow">

 

Means the page will be indexed, to avoid this use:

<meta name="robots" content="noindex,nofollow">

 

To add to that for the OP:  nofollow does not mean that Google will not crawl/follow links on that page.  Nofollow is often a very misunderstood feature in that it's set by a page to basically say, "the links on this page are not very trustworthy and we do not want to take responsibility for their content".  With that said, using nofollow on your site for internal link structure is not a good idea.  People say you can use it for PR sculpting, but that's BS.  Overuse of nofollow on internal links can damage your trust.  Just let the juice flow.