blmg2009 Posted August 5, 2015 Share Posted August 5, 2015 Is it possible to log into another website maybe by using cURL and then using there search feature and extract the information. Or would this not be possible as the sessions created when logging into the site not correctly save / register. Quote Link to comment Share on other sites More sharing options...
scootstah Posted August 5, 2015 Share Posted August 5, 2015 Yes it's possible. cURL can save and send cookies just like a browser can. 1 Quote Link to comment Share on other sites More sharing options...
QuickOldCar Posted August 6, 2015 Share Posted August 6, 2015 Not always possible if they check same domains or js redirects trying to prevent that. Some websites want to force users to use their own site directly. As for extracting the data, it's frowned upon and should get their permission or see if they have a feed or an api. 1 Quote Link to comment Share on other sites More sharing options...
blmg2009 Posted August 6, 2015 Author Share Posted August 6, 2015 Thank you guys for your response. The data extracted is just product results page from my suppliers; I'm creating one page to search all my suppliers to see who supplies the part number I'm looking for to save my having to try the same part number on each website. Unfortunately these websites aren't the most advance so will not have an API. I will ask permission before extracting any results from the search. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.