BizLab Posted June 28, 2010 Share Posted June 28, 2010 I'm looking for a way to block any bots or spiders visiting my site that are unnamed. I'm not sure if i should to "white-list" the good bots using the deny from syntax, but if new spiders are released from the good companies (google, yahoo) i wouldn't want to block their access. Does anyone have a great technique to block unnamed bots?? Thanks Link to comment https://forums.phpfreaks.com/topic/206070-how-to-block-any-undefined-bots-and-spiders-with-htaccess/ Share on other sites More sharing options...
cags Posted June 30, 2010 Share Posted June 30, 2010 Something like this may work... RewriteCond %{HTTP_USER_AGENT} ^$ RewriteRule .* - [F,L] Link to comment https://forums.phpfreaks.com/topic/206070-how-to-block-any-undefined-bots-and-spiders-with-htaccess/#findComment-1079090 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.