RobertP Posted February 20, 2012 Share Posted February 20, 2012 so, i am looking for a list of user-agents / hosts / ip for popular spiders. i have found lists containing bots i have never herd of, i am interested in ones like google, yahoo, msn, alexa, ask jeeves, bing, you know .. anyone have one they know of? Link to comment https://forums.phpfreaks.com/topic/257354-spider-tracking/ Share on other sites More sharing options...
scootstah Posted February 20, 2012 Share Posted February 20, 2012 First Google result Link to comment https://forums.phpfreaks.com/topic/257354-spider-tracking/#findComment-1319146 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.