Jump to content

How can I retrieve data quickly from RSS without hammering?


Berre

Recommended Posts

I have an external RSS feed that I want to check regularly. The feed doesn't update often (maybe once or twice a week), but when it does, I want to be informed within a fairly short time.

 

RSS readers and such gets updated with only a few minutes after a feed is updated, but are they downloading the RSS file every 3 minutes or is there some other way to ask for last updated timestamp of a document or something?

 

I fear that retrieving external RSS feeds every 3 minutes with file_get_contents() and parsing it with SimpleXML() to look for updates would result in a ban due to continuous hammering. Or is this what all RSS readers does? I don't need to update every 3 minutes or so, but it shouldn't take longer than 15 minutes or so.

Check if your RSS provider has something like a checksum or hash value of the newest RSS.

If so you can use it to check for changed else you have to download the RSS over and over again.

I guess you're not getting banned for this (except you download it 100 times a second)

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.