andreastein
-
Posts
1 -
Joined
-
Last visited
Never
We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.
Parsing very large xml file
in PHP Coding Help
Posted
I need to load and parse a very large XML file (over 5 million lines) daily, and then dump its contents into a database. I increased the max_execution_timeout to 5 minutes. However, the script seems to stop after 30 seconds or so. No error is printed, and it stops in a different place each time. I'm printing the execution time in my script, using ini_get, to make sure it's 300, and it is. Any other reasons this may happen, or tips for reading such a huge file? I tried using 2 scripts and passing the last byte read between them using fseek(), but b/c i'm passing a url to fopen, it looks like I'm out of luck there.
Any help much much appreciated!
Thx.