phpdeveloper82 Posted October 29, 2009 Share Posted October 29, 2009 Hello, I have lot of data on my website. what are the steps, I need to take to prevent a person or any scripts copying these data. I heard that, with a scrawler these data can be copy within minutes. I need to avoid such situations. Thank you Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/ Share on other sites More sharing options...
Daniel0 Posted October 29, 2009 Share Posted October 29, 2009 I suppose you can restrict the number of requests from an IP address within the last X units of time. The only fool proof way of preventing people from downloading your website is to not publish it at all, however. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-946929 Share on other sites More sharing options...
phpdeveloper82 Posted October 29, 2009 Author Share Posted October 29, 2009 The only fool proof way of preventing people from downloading your website is to not publish it at all, however. Great words!! I will keep these words in mind.. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-946967 Share on other sites More sharing options...
JonnoTheDev Posted October 29, 2009 Share Posted October 29, 2009 At the end of the day, if someone badly wants your data, they will get it. However you can make it more difficult to obtain. As I have not seen what sort of data you are displaying it is not easy to say how simple it is to extract. Couple of ideas: 1. Use a CAPTCHA graphic within a form before any data can be accessed. If the code is correctly inserted set a session. Check for this session on all pages displaying data. 2. As suggested check the number of requests per IP. This is not foolproof however as someone with a large number of proxies could change their IP on every request. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947046 Share on other sites More sharing options...
JonnoTheDev Posted October 29, 2009 Share Posted October 29, 2009 Also displaying data using the DOM from AJAX requests makes it difficult to scrape. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947114 Share on other sites More sharing options...
Daniel0 Posted October 29, 2009 Share Posted October 29, 2009 Also displaying data using the DOM from AJAX requests makes it difficult to scrape. Yeah, but it also makes it difficult (read: impossible) for people browsing without Javascript turned on, or people who use UAs that do not support Javascript at all (screen readers, lynx, etc.). Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947151 Share on other sites More sharing options...
JonnoTheDev Posted October 29, 2009 Share Posted October 29, 2009 Yeah, but it also makes it difficult (read: impossible) for people browsing without Javascript turned on, or people who use UAs that do not support Javascript at all (screen readers, lynx, etc.). Agreed Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947153 Share on other sites More sharing options...
corbin Posted October 30, 2009 Share Posted October 30, 2009 1. Use a CAPTCHA graphic within a form before any data can be accessed. If the code is correctly inserted set a session. Check for this session on all pages displaying data. The the user could enter the CAPTCHA once and pass the session ID to a mining program. Really just adds one small layer. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947552 Share on other sites More sharing options...
JonnoTheDev Posted October 30, 2009 Share Posted October 30, 2009 The the user could enter the CAPTCHA once and pass the session ID to a mining program. Really just adds one small layer. Of course. There will always be a way, however making things a little bit more difficult will deter some. People who use windows apps for web scraping etc should be put off. Quote Link to comment https://forums.phpfreaks.com/topic/179472-prevent-data-available-on-the-site/#findComment-947693 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.