Using cURL to Visit a page....

[WeirdMystery]

Hello guys, I am making a page viewer bot. The PHP script will use cURL to visit the site.

 

I've got it working, however, It takes a whole lot of download bandwidth to use it. My question is, when you tell the cURL session to execute and go to the page, is it actually downloading the page server-side? Because I am actually going to make this a public service and I don't want it to waste loads of bandwidth.

 

All I want the script to do is make the site think I've visited the page.

 

<?
    $url = "examplesite.com";
    curl_setopt ($curl, CURLOPT_URL, "$url" );
    curl_setopt ($curl, CURLOPT_RETURNTRANSFER, 1 );
    $exec = curl_exec ($curl);
    
    curl_close ($curl);
?>

 

[premiso]

Yes, that will download the entire page. To just get the page headers you can use this:

 

CURLOPT_NOBODY  TRUE to exclude the body from the output. Request method is then set to HEAD. Changing this to FALSE  does not change it to GET.

 

With the curl_setopt to just get the headers.

[WeirdMystery]

Yes, that will download the entire page. To just get the page headers you can use this:

 

CURLOPT_NOBODY  TRUE to exclude the body from the output. Request method is then set to HEAD. Changing this to FALSE  does not change it to GET.

 

With the curl_setopt to just get the headers.

 

Thanks man, it took way faster and it took less bandwidth. Thanks again.