Jump to content

How can I retrieve data quickly from RSS without hammering?


Recommended Posts

I have an external RSS feed that I want to check regularly. The feed doesn't update often (maybe once or twice a week), but when it does, I want to be informed within a fairly short time.

 

RSS readers and such gets updated with only a few minutes after a feed is updated, but are they downloading the RSS file every 3 minutes or is there some other way to ask for last updated timestamp of a document or something?

 

I fear that retrieving external RSS feeds every 3 minutes with file_get_contents() and parsing it with SimpleXML() to look for updates would result in a ban due to continuous hammering. Or is this what all RSS readers does? I don't need to update every 3 minutes or so, but it shouldn't take longer than 15 minutes or so.

Check if your RSS provider has something like a checksum or hash value of the newest RSS.

If so you can use it to check for changed else you have to download the RSS over and over again.

I guess you're not getting banned for this (except you download it 100 times a second)

This thread is more than a year old. Please don't revive it unless you have something important to add.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.