jjmusicpro Posted October 24, 2007 Share Posted October 24, 2007 How do i make a robots.txt file so that no files on my server / domain are index? Quote Link to comment Share on other sites More sharing options...
Wuhtzu Posted October 24, 2007 Share Posted October 24, 2007 #1: Not a PHP question #2: Google -> robots.txt Quote Link to comment Share on other sites More sharing options...
jjmusicpro Posted October 24, 2007 Author Share Posted October 24, 2007 I know its not a php question, i was just thinking someone here knew a quick way. I dont want to allow any bots, to index any of my files or subdomains... Quote Link to comment Share on other sites More sharing options...
Wuhtzu Posted October 24, 2007 Share Posted October 24, 2007 The "I'm posting in PHP Help because more ppl will see my question and I'll get a quicker answer"-mentality is pure and it a bad circle. The more people who think like that the less people are actually looking in the less used forums and as a result more people start to think this way... Google has the quick answer: http://en.wikipedia.org/wiki/Robots.txt http://www.thesitewizard.com/archive/robotstxt.shtml http://www.robotstxt.org/wc/norobots.html Alternatively if the site is in development and you do not want any robots to index "not completed pages" you could simply restrict all access to the site except from your own IP address... Do it in PHP or use .htaccess Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.