sangnhoc Posted June 16, 2015 Share Posted June 16, 2015 now there are many pages with CloudFlare told you should not get the crawler, eg kissanime.com page, I do not get content.help me, please Link to comment Share on other sites More sharing options...
requinix Posted June 16, 2015 Share Posted June 16, 2015 What are you talking about? Link to comment Share on other sites More sharing options...
sangnhoc Posted June 17, 2015 Author Share Posted June 17, 2015 I'm crawler kissanime.com page. error 503. I used crawler library. please help me how to get html tks all Link to comment Share on other sites More sharing options...
sangnhoc Posted June 17, 2015 Author Share Posted June 17, 2015 (edited) $crl = curl_init(); $url = "http://kissanime.com/"; curl_setopt($crl, CURLOPT_URL, $url); curl_setopt($crl, CURLOPT_HEADER, 1); curl_setopt($crl, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows NT 6.3; WOW64; rv:31.0) Gecko/20100101 Firefox/31.0'); curl_setopt ($crl, CURLOPT_FOLLOWLOCATION, false); curl_setopt($crl, CURLOPT_FOLLOWLOCATION, 1); curl_setopt($crl, CURLOPT_RETURNTRANSFER, 1); $content = curl_exec($crl); curl_close ($crl); Use Curl do not get content. Edited June 17, 2015 by sangnhoc Link to comment Share on other sites More sharing options...
Solution requinix Posted June 17, 2015 Solution Share Posted June 17, 2015 (edited) CloudFlare is using a mechanism that is specifically designed to prevent people from doing the kinds of things you're trying to do. You're out of luck. Edited June 17, 2015 by requinix Link to comment Share on other sites More sharing options...
Recommended Posts