MemphiS Posted June 20, 2007 Share Posted June 20, 2007 Does having these two things on your site create a security risk in any way? other then telling people i guess what directories you wish robots to keep out of? Quote Link to comment Share on other sites More sharing options...
MemphiS Posted June 21, 2007 Author Share Posted June 21, 2007 bump... Quote Link to comment Share on other sites More sharing options...
genericnumber1 Posted June 21, 2007 Share Posted June 21, 2007 no.. but I suppose people COULD in theory find what you're trying to hide without much effort... disallow /privatestuff really? Use authentication if you're trying to hide something critical from a crawler. Use robots.txt to keep them from crawling something useless like a 404 error page. Quote Link to comment Share on other sites More sharing options...
btherl Posted June 21, 2007 Share Posted June 21, 2007 http://www.robotstxt.org/wc/faq.html#nosecurity The above basically says what genericnumber1 says.. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.