Mutley Posted March 18, 2009 Share Posted March 18, 2009 Is there a rewrite to stop spiders looking through pages under a certain directory? Thanks in advance, Nick. Link to comment https://forums.phpfreaks.com/topic/150024-search-spiders/ Share on other sites More sharing options...
corbin Posted March 18, 2009 Share Posted March 18, 2009 You could use a robots.txt. Link to comment https://forums.phpfreaks.com/topic/150024-search-spiders/#findComment-788013 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.