Imad Posted March 31, 2008 Share Posted March 31, 2008 Hi guys, is their a way to disallow bots using php instead of robots.txt? Regards. Quote Link to comment Share on other sites More sharing options...
BlueSkyIS Posted March 31, 2008 Share Posted March 31, 2008 yes, sort of. check the user agent. but if they don't send user agent, it won't work. if you can find a decent list of robot IPs, you could exclude those ips. Quote Link to comment Share on other sites More sharing options...
maexus Posted March 31, 2008 Share Posted March 31, 2008 The user agent isn't reliable. If a bot doesn't want to follow robots.txt, it's likely to spoof the user agent Quote Link to comment Share on other sites More sharing options...
Imad Posted March 31, 2008 Author Share Posted March 31, 2008 Ok, thanks for the info guys. Quote Link to comment Share on other sites More sharing options...
roopurt18 Posted March 31, 2008 Share Posted March 31, 2008 Are you trying to combat spam on your site? Quote Link to comment Share on other sites More sharing options...
Imad Posted March 31, 2008 Author Share Posted March 31, 2008 Are you trying to combat spam on your site? Nope, just trying to figure out a way to manage everything through php. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.