N-Bomb(Nerd) Posted October 5, 2011 Share Posted October 5, 2011 Hi, How do I make my website so that no search engines come to my website and index it? Quote Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/ Share on other sites More sharing options...
requinix Posted October 5, 2011 Share Posted October 5, 2011 User-Agent: * Disallow: / That'll catch the ones who play nicely. The rest... well, you can try with user-agent and IP bans, but ultimately you can't prevent them from indexing it if they really want to. Quote Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276163 Share on other sites More sharing options...
markjoe Posted October 5, 2011 Share Posted October 5, 2011 Otherwise, put the content behind your favorite flavor of authentication. Quote Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276164 Share on other sites More sharing options...
djlee Posted October 5, 2011 Share Posted October 5, 2011 AuthUserFile /path/to/htpasswd AuthType Basic require valid-user Quote Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276165 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.