Scooby-Doo Posted May 27, 2012 Share Posted May 27, 2012 hi Just another quicky...what is best way to tell google to leave certain pages alone, would it be through robots or can you do something in htaccess to stop googlebot indexing certain pages...or any other way??? Cheers Quote Link to comment https://forums.phpfreaks.com/topic/263231-google-leave-them-pages-well-alone/ Share on other sites More sharing options...
QuickOldCar Posted May 27, 2012 Share Posted May 27, 2012 Can use robots.txt some for instances, * will do pattern matching, the $ at end will be specific endings User-agent: * Disallow: /users/ Disallow: /images/ Disallow /print*/ Disallow: /*.pdf$ To not follow links on a page add this <meta name="robots" content="nofollow" /> To not follow a specific page, add similar to this <a href="links.html" rel="nofollow" /> May also use this in your http headers X-Robots-Tag: noindex Quote Link to comment https://forums.phpfreaks.com/topic/263231-google-leave-them-pages-well-alone/#findComment-1349064 Share on other sites More sharing options...
ignace Posted May 28, 2012 Share Posted May 28, 2012 <meta name="robots" content="nofollow"> Means the page will be indexed, to avoid this use: <meta name="robots" content="noindex,nofollow"> Quote Link to comment https://forums.phpfreaks.com/topic/263231-google-leave-them-pages-well-alone/#findComment-1349139 Share on other sites More sharing options...
mrMarcus Posted May 28, 2012 Share Posted May 28, 2012 <meta name="robots" content="nofollow"> Means the page will be indexed, to avoid this use: <meta name="robots" content="noindex,nofollow"> To add to that for the OP: nofollow does not mean that Google will not crawl/follow links on that page. Nofollow is often a very misunderstood feature in that it's set by a page to basically say, "the links on this page are not very trustworthy and we do not want to take responsibility for their content". With that said, using nofollow on your site for internal link structure is not a good idea. People say you can use it for PR sculpting, but that's BS. Overuse of nofollow on internal links can damage your trust. Just let the juice flow. Quote Link to comment https://forums.phpfreaks.com/topic/263231-google-leave-them-pages-well-alone/#findComment-1349229 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.