oracle765 Posted November 11, 2015 Share Posted November 11, 2015 Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.59.52) [Label IP Address] Referring URL:(No referring link) Visit Page: UK Airport Parking Prices & Charges | Compare & Choose Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.54.225) [Label IP Address] Referring URL:(No referring link) Entry Page: Shopping Prices & Online Shopping Deals in Australia Exit Page: Compare Travel Insurance Prices & Quotes | Compare & Choose Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.62.56) [Label IP Address] Referring URL:(No referring link) Entry Page: Switch Energy Suppliers and save | Compare & Choose Exit Page: Trauma Insurance Cover & Quotes | Compare & Choose Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.59.127) [Label IP Address] Referring URL:(No referring link) Entry Page: Compare and choose home loans, products and services Exit Page: Our Terms and Conditions | Compare & Choose Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.55.230) [Label IP Address] Referring URL:(No referring link) Entry Page: Contact Compare and Choose by email or telephone Exit Page: Compare Sports Products & Goods | Compare & Choose Total Visits:1 Location:Ashburn, Virginia, United States IP Address:Amazon.com (54.174.55.240) [Label IP Address] Referring URL:(No referring link) Entry Page: Compare Home & Garden Store Prices | Compare & Choose Exit Page: Compare Shoes, Trainers & Footwear Prices | Compare & Choose Hi Professionals Our website is written in php on a Linux We are currently being trawled by the following address, as you can see it is the same place but a different IP every time Is there a way to stop this thanks in avance Quote Link to comment https://forums.phpfreaks.com/topic/299448-block-scraper/ Share on other sites More sharing options...
mac_gyver Posted November 12, 2015 Share Posted November 12, 2015 It's a safe bet that nothing being hosted on or through an amazon web services server should be making requests to your web site. however, doing a whois ip lookup for two of those ip addresses, gives the following information - http://www.whois.com/whois/54.174.55.230 and http://www.whois.com/whois/54.174.62.56 these are apparently for a company named hubspot. those two whois lookups have different abuse contacts. get the whois lookup information for each of the different ip addresses you are getting requests from, then do two things - 1) provide the abuse contact(s) with the ip and datetime information about the requests. they should be able to determine for that set of ip addresses and datetime, what is sending the requests (perhaps they have a bot/proxy running on their system(s).) 2) find the range of ip addresses that each of the ip addresses is part of and assuming you are using an Apache web server, add an entry in a domain root .htaccess file that blocks (deny) requests from that entire range. repeat for any other ranges of ip addresses. Quote Link to comment https://forums.phpfreaks.com/topic/299448-block-scraper/#findComment-1526248 Share on other sites More sharing options...
oracle765 Posted November 13, 2015 Author Share Posted November 13, 2015 thank you mac_gyver I will do that Quote Link to comment https://forums.phpfreaks.com/topic/299448-block-scraper/#findComment-1526314 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.