Miles LLC Posted August 20, 2011 Share Posted August 20, 2011 Ok, I know how to screen scrape, but I don't know how to screen scrape when there is a login. I've looked this up for awhile, but no luck. I'd like to also make it so I can execute a url when I am logged in on the script for the script, for an example execute this url: http://site.com/data.php?id=9912&submit=1 Thanks in advanced. Quote Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/ Share on other sites More sharing options...
Psycho Posted August 20, 2011 Share Posted August 20, 2011 Use cURL: http://php.net/manual/en/book.curl.php To get started look up some tutorials Quote Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259645 Share on other sites More sharing options...
Miles LLC Posted August 20, 2011 Author Share Posted August 20, 2011 I use cURL already to screenscrape data, but I can't scrape pass a login screen. Quote Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259647 Share on other sites More sharing options...
darkfreaks Posted August 20, 2011 Share Posted August 20, 2011 http://dev.juokaz.com/php/scraping-login-requiring-websites-with-curl this what you looking for mate Quote Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259650 Share on other sites More sharing options...
codefossa Posted August 20, 2011 Share Posted August 20, 2011 Log in manually from your own comp. Grab the cookie "javascript:void(alert(window.document.cookie));" and add it to CURLOPT_COOKIE. Until your session is removed from the server (you log out or expire), it should be fine. I use it on a daily basis. Quote Link to comment https://forums.phpfreaks.com/topic/245252-screen-scraping/#findComment-1259654 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.