Posted 17 August 2006 - 01:14 PM
Could somebody please explain how I would use the robots.txt to stop search engines indexing all of my site, except my index page.
Could someone please give me an example of what i put in the robots.txt, and do I need to add anything to my HTML or PHP pages?
Thanks in advance
Posted 17 August 2006 - 01:15 PM
Posted 17 August 2006 - 01:21 PM
Am I correct in thinking that you didnt need the second disallow above because you have already disallowed access to the folder? or has each page got to be disallowed individually?
Posted 17 August 2006 - 01:24 PM
<META NAME="robots" CONTENT="index, follow" />
0 user(s) are reading this topic
0 members, 0 guests, 0 anonymous users