[SOLVED] How to import to database from text file?

[lopes_andre]

Hi,

 

I have a list of e-mails in a TXT file and I need to put that e-mails in a MySQL database. I need also to not insert duplicate e-mails.

 

There is a best way to do this?

 

Best Regards,

André.

[Maq]

*NOT TESTED

 

Put all the emails in an array then use array_unique to rid all duplicates.  Use a foreach loop to traverse through the array and insert each one in the database.

 

$lines=file('test.txt');
foreach($lines as $line) {
   $arr[] = $line;
}
$arr = $array_unique($arr);

foreach($arr as $value) {
   $sql = "INSERT INTO table (email) VALUES ('$value')";
}

mysql_query($sql) or die(mysql_error());

 

P.S. - You may need to clean these variables with mysql_real_escape_string, trim stuff like that.  Hope this helps!

[fenway]

Or, use mysql for what databases are for... add a UNIQUE index, and use insert ignore.

[lopes_andre]

Thanks for your help!!

 

Solved. I have added the UNIQUE to the email field.

 

<?php

$username="root";
$password="";
$database="emaillist_lp_pt";

mysql_connect(localhost,$username,$password);
@mysql_select_db($database) or die( "Unable to select database");

$lines=file('test.txt');
foreach($lines as $line) {
   $arr[] = $line;
   $sql = "INSERT IGNORE INTO emails VALUES ('', '$line', '0', NOW())";
   mysql_query($sql);
}

?>

 

I will import a file with more than 20MB. It will be any problem with the file size?

 

Best Regards,

André.

[Maq]

The file size should be fine as it is very small for DB data.

 

I would run this script via CLI.

 

Nice script BTW, short 'n sweet!