Jump to content


Photo

Is this possible within PHP? If not - what technology do I need?


  • Please log in to reply
7 replies to this topic

#1 Anidazen

Anidazen
  • Members
  • PipPipPip
  • Advanced Member
  • 79 posts

Posted 17 September 2006 - 02:49 PM

I provide a service that involves looking up 10+ websites and parsing them in real time.

I really can't wait for 10 sites to load one after the other. Is it possible to load all 10 at once with PHP, or is that beyond the boundaries of what can be achieved?

If it *is* beyond PHP's capability, what language/technology would I need to use?

#2 redarrow

redarrow
  • Members
  • PipPipPip
  • Advanced Member
  • 7,308 posts
  • Locationlondon

Posted 17 September 2006 - 02:53 PM

I provide a service that involves looking up 10+ websites and parsing them in real time.


how are you doing it know please provide an example as there meny ways.
Wish i new all about php DAM i will have to learn
((EMAIL CODE THAT WORKS))
http://simpleforum.ath.cx/mail2.inc
((PAYPAL INTEGRATION THAT WORKS))
http://simpleforum.a...aypal1_info.inc

#3 Anidazen

Anidazen
  • Members
  • PipPipPip
  • Advanced Member
  • 79 posts

Posted 17 September 2006 - 03:08 PM

how are you doing it know please provide an example as there meny ways.


I am going to each site, opening a CURL connection, retrieving the site, and then parsing it.

#4 redarrow

redarrow
  • Members
  • PipPipPip
  • Advanced Member
  • 7,308 posts
  • Locationlondon

Posted 17 September 2006 - 03:13 PM

Well if you got large bandwidth no problam otherwise no advise sorry.
Wish i new all about php DAM i will have to learn
((EMAIL CODE THAT WORKS))
http://simpleforum.ath.cx/mail2.inc
((PAYPAL INTEGRATION THAT WORKS))
http://simpleforum.a...aypal1_info.inc

#5 Daniel0

Daniel0
  • Staff Alumni
  • Advanced Member
  • 11,956 posts

Posted 17 September 2006 - 03:13 PM

You can't do more than one thing at a time, that goes for all the other languages as well.

#6 Anidazen

Anidazen
  • Members
  • PipPipPip
  • Advanced Member
  • 79 posts

Posted 17 September 2006 - 04:46 PM

You can't do more than one thing at a time, that goes for all the other languages as well.


Surely there must be some method. My desktop computer can look up 200 websites simultaneously.

There's absolutely no technology that can avoid the script stopping and standing around waiting for each and every site?

#7 redarrow

redarrow
  • Members
  • PipPipPip
  • Advanced Member
  • 7,308 posts
  • Locationlondon

Posted 17 September 2006 - 04:53 PM

the larger the bandwidth the faster the pages you get and thats it ok.
Wish i new all about php DAM i will have to learn
((EMAIL CODE THAT WORKS))
http://simpleforum.ath.cx/mail2.inc
((PAYPAL INTEGRATION THAT WORKS))
http://simpleforum.a...aypal1_info.inc

#8 Wintergreen

Wintergreen
  • Members
  • PipPipPip
  • Advanced Member
  • 107 posts

Posted 17 September 2006 - 05:14 PM

My only advice would be to find some way of caching the sites, unless they are being updated very quickly and you have to have the latest info from them.  Then you can just recache them every few hours or something along those lines. 




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users