Miles LLC Posted August 20, 2011 Share Posted August 20, 2011 Ok, I know how to screen scrape, but I don't know how to screen scrape when there is a login. I've looked this up for awhile, but no luck. I'd like to also make it so I can execute a url when I am logged in on the script for the script, for an example execute this url: http://site.com/data.php?id=9912&submit=1 Thanks in advanced. Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/ Share on other sites More sharing options...
Psycho Posted August 20, 2011 Share Posted August 20, 2011 Use cURL: http://php.net/manual/en/book.curl.php To get started look up some tutorials Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259645 Share on other sites More sharing options...
Miles LLC Posted August 20, 2011 Author Share Posted August 20, 2011 I use cURL already to screenscrape data, but I can't scrape pass a login screen. Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259647 Share on other sites More sharing options...
darkfreaks Posted August 20, 2011 Share Posted August 20, 2011 http://dev.juokaz.com/php/scraping-login-requiring-websites-with-curl this what you looking for mate Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259650 Share on other sites More sharing options...
codefossa Posted August 20, 2011 Share Posted August 20, 2011 Log in manually from your own comp. Grab the cookie "javascript:void(alert(window.document.cookie));" and add it to CURLOPT_COOKIE. Until your session is removed from the server (you log out or expire), it should be fine. I use it on a daily basis. Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259654 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.