N-Bomb(Nerd) Posted October 5, 2011 Share Posted October 5, 2011 Hi, How do I make my website so that no search engines come to my website and index it? Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/ Share on other sites More sharing options...
requinix Posted October 5, 2011 Share Posted October 5, 2011 User-Agent: * Disallow: / That'll catch the ones who play nicely. The rest... well, you can try with user-agent and IP bans, but ultimately you can't prevent them from indexing it if they really want to. Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276163 Share on other sites More sharing options...
markjoe Posted October 5, 2011 Share Posted October 5, 2011 Otherwise, put the content behind your favorite flavor of authentication. Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276164 Share on other sites More sharing options...
djlee Posted October 5, 2011 Share Posted October 5, 2011 AuthUserFile /path/to/htpasswd AuthType Basic require valid-user Link to comment https://forums.phpfreaks.com/topic/248506-robots-question/#findComment-1276165 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.