script to count and remove duplicate lines in file

[devWhiz]

is this possible?

[wildteen88]

You can use file to read each line into an array. Then use array_unique to grab all unique values. Lastly  implode the array back into a string to be written back to the file.

[devWhiz]

$filename = 'user_ids.txt';
$text = array_unique(file($filename));
$userids = @fopen($filename,'w+');
if($userids)
{
  fputs($userids, join('',$text));
  fclose($userids);
}

 

would what you said be more efficient than this?

[wildteen88]

Yea, that should do fine. Its pretty much what I'd do. join is the same as implode.