RobertP Posted February 20, 2012 Share Posted February 20, 2012 so, i am looking for a list of user-agents / hosts / ip for popular spiders. i have found lists containing bots i have never herd of, i am interested in ones like google, yahoo, msn, alexa, ask jeeves, bing, you know .. anyone have one they know of? Quote Link to comment Share on other sites More sharing options...
scootstah Posted February 20, 2012 Share Posted February 20, 2012 First Google result Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.