[SOLVED] Stripping URLs from a page

[NinaDizz]

Hi all

 

I need a function or class to go through a HTML document, and strip out all of the URLs and then store them in an array.

 

Anyone got one or know where I could get one?

 

TIA!

 

Nina

 

[MadTechie]

you can find all the functions required here or someone here could probably do the whole thing for you.

 

if they don't work try here

[NinaDizz]

I tried there, didn't have any luck. I couldn't go there, as I have very few pennies. And I also tried there, as I still am, for the past two hours, without any joy.

 

Nina

[MadTechie]

what do you have so far ?

[MadTechie]

here's a basic start to the hard part

 

<?php
preg_match_all('/href=["|\']+(.*)["|\']+/sim', $subject, $result, PREG_PATTERN_ORDER);
$result = $result[0];
?>

 

good luck with the opening contents of remote file etc

[maxim]

easy just use file_get_contents, and it will put a local or a remote file in one big string.

[NinaDizz]

TBH its pretty woeful so far.

 

What I've written (despite being horrible) is returning the first URL in the source.html file, but then isn't outputting any more, even though I can see that it's found more.

 

<?php
$source_file = file_get_contents ('source.html');
$each_letter = str_split ($source_file);
for($i = 0; $i <count($each_letter); $i++) {
if ($each_letter[$i] == '<' && $each_letter[$i+1] == 'a' && $each_letter[$i+2] == ' ' && $each_letter[$i+3] == 'h' && $each_letter[$i+4] == 'r' && $each_letter[$i+5] == 'e' && $each_letter[$i+6] == 'f' && $each_letter[$i+7] == '=' && $each_letter[$i+8] == '"') {
	$count_urls++;
	$this_url = '';
	$j = 0;
	while($check_for_end != '"') {
		$this_url .= $each_letter[$i + 9 + $j];
		$j++;
		$check_for_end = $each_letter[$i + 9 + $j];
	}
	echo $count_urls.' - '.$this_url.'<hr />';
}
}
echo $count_urls;
?>

 

Nina

[NinaDizz]

Oh, MadTechie, thanks for the regex btw, I'm playing around with it now, but still losing hair by the second

[MadTechie]

OK thats a long script,

try something like this

<?php
$URL = 'http://uk3.php.net/manual/en/';
$subject = file_get_contents ($URL);
preg_match_all('/(?:href="([^"]*)"+)|(href=\'([^\'])*\'+)/i', $subject, $result, PREG_PATTERN_ORDER);
$result = preg_replace('/(?:href="([^"]*)"+)|(href=\'([^\'])*\'+)/i', '$1', $result[0]);
echo "<pre>";
print_r($result); //$result being the array list 
?>

[NinaDizz]

Thanks for that. A lot more efficient! I'll work with that snippet from now on.

 

Thanks again!