CSV file fatal error

[RichardRotterdam]

Hi,

 

I am trying to download a csv from a remote server. Loading data from a remote server isnt a problem but the CSV file I am trying to download is very big and i get a fatal error everytime i try to load the whole thing in a variable.

 

Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 17664191 bytes) 

 

the url of the CSV file is http://xml.ds1.nl/getcsv/?wi=58654&si=510&xid=83&ws=

 

is storing all this data in a php var even possible?

[laffin]

download it

parse it

store entries in a db

 

use functions fopen/fgets/fclose

fgets grabs a single line from the file, so u can explode it into an array.

 

$entry=explode(';',$row);

 

than store it in a local db Mysql/Sqlite or similar

 

[RichardRotterdam]

even when stored on the local computer as a csv file it's too big to pass as a php string any ideas how to handle a large file

[laffin]

reason u use fgets

ur not loading the entire file into memory, you are parsing it a section at a time

fgets gets one line from the file

[PFMaBiSmAd]

For a csv file, using fgetcsv would kill two birds with one stone - http://php.net/fgetcsv

[RichardRotterdam]

Thanks now that is something I can use I'll look in to this and tell wether I made it work or not

[laffin]

lol

php never ceases to amaze me by sheer amount of functions it has for doing things.