Jump to content

Processing Large XML Files


pugboy

Recommended Posts

I have an XML file that is ~50MB, and is likely to grow to 100MB+ in the next 6 months... I basically need to take this XML file and read the entries and store them in a database for access in a website.

 

I know how to use SimpleXML to do the reading/writing to the database, but apparently loads the entire thing into an object-- less than ideal for huge files.

 

I have a dedicated server which I can do the processing on if needed and it has a memory limit of 32MB. It has 1GB of RAM, so I assume I can probably increase the memory limit if needed... I am not very familiar with server administration, but that is for another topic...

 

What would be the best way to process this XML file? I have looked around a bit and it looks like a SAX parser or XMLReader could work... If possible, I would like to use SimpleXML (because it is a lot easier to use), but I guess I could go for any framework or parser that worked.

Link to comment
https://forums.phpfreaks.com/topic/204040-processing-large-xml-files/
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.