BizLab Posted June 28, 2010 Share Posted June 28, 2010 I'm looking for a way to block any bots or spiders visiting my site that are unnamed. I'm not sure if i should to "white-list" the good bots using the deny from syntax, but if new spiders are released from the good companies (google, yahoo) i wouldn't want to block their access. Does anyone have a great technique to block unnamed bots?? Thanks Quote Link to comment Share on other sites More sharing options...
cags Posted June 30, 2010 Share Posted June 30, 2010 Something like this may work... RewriteCond %{HTTP_USER_AGENT} ^$ RewriteRule .* - [F,L] Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.