Run multiple 'file_get_contents' at a time?

[joecooper]

My website involves loading several other pages at a time to produce results from all of them. The problem I had was loading times with some websites taking upto 10 seconds, where as others would take less than 1 second.

 

I ended up setting the timeout feature in the PHP.ini file to 1 second, which is fine not to include results from slow loading pages.

 

But I would like to be able to load all 10 web pages using "file_get_contents" simultaniously since the connection on my server is a good 100Mb. 

 

Is this possible?

 

Thanks

[Jessica]

You could run the script to get the data in the background and save it to your own database, then select the data out of that when you need it.

 

As long as you're allowed to be doing what you're doing.

[requinix]

cURL can do multiple connections at once. See curl_multi_init for an example.

[trq]

You might also look into reactphp (http://reactphp.org). An asynchronous non-blocking framework for php.

[joecooper]

You could run the script to get the data in the background and save it to your own database, then select the data out of that when you need it.

 

As long as you're allowed to be doing what you're doing.

 

This is actually what I thought about doing, just that when someone makes a new search, there wont be any results the first time untill my script indexes the results.