cURL question

[Minase]

hello today i saw that my scripts are running slow i was debuging them and the performance leak was in curl

it was getting the site content too slow

 

is there a way to increase performance?

what is the best method (fast get) for getting webpages with curl?

thank you

[abazoskib]

if you dont need the body of the response, a good setting to set to true is CURLOPT_NOBODY, however i think since you are downloading webpages that might not be useful. try it, but other than that i think it has to do with your server's internet connection, and that of the sites you are downloading from. without much more detail from you thats all i can think of.

[deviantPsyche]

The best way to increase the performance of your script if you're using curl is to use multicurl. I found a very useful class which I was able to implement into my scripts at http://www.phpclasses.org/browse/package/4091.html the only thing you can do with it is to load multiple pages though. If you need to do something else like load, pregmatch, and then load again then you will have to modify this class yourself. I haven't figured out how to do that myself yet...

[Minase]

thank you very much i will look into it never thought of it

i will let this topic open a little more to see what i can do with multi curl