oceans Posted July 21, 2007 Share Posted July 21, 2007 Dear Friends, I am setting up my web site, though it is still under construction. I get the following error message being recorded in my error log file. " [client XX.6.75.16] File does not exist: robots.txt " I agree I do not have this file, but I do not understand why am I getting this. Can any one help me, must I put this file in my root? Quote Link to comment Share on other sites More sharing options...
hackerkts Posted July 21, 2007 Share Posted July 21, 2007 Do you know what's robots.txt for? If you're not sure then just search about it, anyway putting it will not harm you. robots.txt User-Agent: * Allow: Quote Link to comment Share on other sites More sharing options...
oceans Posted July 23, 2007 Author Share Posted July 23, 2007 Thanks, I just read on on the web, thanks, I understood. Quote Link to comment Share on other sites More sharing options...
hackerkts Posted July 23, 2007 Share Posted July 23, 2007 You're welcome! Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.