ffdave77 Posted June 2, 2006 Share Posted June 2, 2006 I am interested in knowing how to securely block search bots and other web bots from reaching sensitive areas of my web site. I know that if you put a .htaccess file in a directory no web bot can touch that area. How to I impliment a similar setting or happening if I don't want .htaccess and have my own login script? All my pages have a script in the first lines of the document which check for login status from a cookie and if you are not logged in you are forced (through the header) to a login page).Any suggestions on this security issue? Do I need to clearify anything? Quote Link to comment Share on other sites More sharing options...
poirot Posted June 2, 2006 Share Posted June 2, 2006 You may want to use robots.txt[a href=\"http://www.robotstxt.org/wc/robots.html\" target=\"_blank\"]http://www.robotstxt.org/wc/robots.html[/a]Or the meta robots:[a href=\"http://www.robotstxt.org/wc/meta-user.html\" target=\"_blank\"]http://www.robotstxt.org/wc/meta-user.html[/a] Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.