oyoyg Posted April 28, 2006 Share Posted April 28, 2006 HiHow can I crawl a password-protected site? (I have a password, and its not illegal because its my own site) Link to comment https://forums.phpfreaks.com/topic/8651-crawl-password-protected-website/ Share on other sites More sharing options...
ober Posted April 28, 2006 Share Posted April 28, 2006 You're going to have to explain yourself a little better. What are you trying to achieve? And if your crawler is smart enough to submit forms, you can certainly crawl whatever is past the authentication. Link to comment https://forums.phpfreaks.com/topic/8651-crawl-password-protected-website/#findComment-31756 Share on other sites More sharing options...
oyoyg Posted April 28, 2006 Author Share Posted April 28, 2006 [!--quoteo(post=369675:date=Apr 28 2006, 02:31 PM:name=ober)--][div class=\'quotetop\']QUOTE(ober @ Apr 28 2006, 02:31 PM) [snapback]369675[/snapback][/div][div class=\'quotemain\'][!--quotec--]You're going to have to explain yourself a little better. What are you trying to achieve? And if your crawler is smart enough to submit forms, you can certainly crawl whatever is past the authentication.[/quote]Yeah, I wan't to give some login information to my crawler, and it has to use it on a login form. After that the session should be set, and it should be possible to crawl the pass protected sites, right? Link to comment https://forums.phpfreaks.com/topic/8651-crawl-password-protected-website/#findComment-31810 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.