[SOLVED] Scan a URL and pull values

[lip9000]

Hey guys, just wondering how would I go about creating a script that scans a url's source code and brings back data contained within certain regions of that page.

 

For example how would I get it to bring back the information contained within the sites title tags, and bring back information contained within a certain field on that page.

 

So the script would be to enter a url, then it scans that page, gets the values located in the spots we want like the title and such, and then brings it back to the page in variables so we can then insert it into a database.

 

Thanks in advance

[bilis_money]

try regex.

[lip9000]

but how do I get php to scan a url's source code first, then use regular expressions right ?

[xenophobia]

try CURL.

[lip9000]

cool thanks, so it would be like

 

<?php print read_file('http://example.com'); ?>

 

Then use reg expression to find whats in between the title tags

[lip9000]

what the???

 

Fatal error: Call to undefined function read_file() in D:\wamp\www\phpnuke\html\tp\url.php on line 9

[lip9000]

Could someone please explain how I would go about using <?php print read_file('http://example.com'); ?>

 

I am getting that error when I use it.

[BlueSkyIS]

readfile()

[lip9000]

how would I use preg replace when i'm not replacing anything??

 

what would be the code to find that value is inbetween the title tags

 

<title>find this info</title>

[DarkWater]

$str = ""; //Whatever you use to get your title...

$title = eregi_replace("<title>([a-zA-Z0-9[:punct:][:space:]]+)</title>", "\\1", $str);

[lip9000]

doesn't seem to work. what am i doing wrong?

 

$str = readfile('http://youtube.com/watch?v=7pVmmsuuc5U');

$title = eregi_replace("<title>([a-zA-Z0-9[:punct:][:space:]]+)</title>", "\\1", $str);

echo $title;

 

 

so basically i want it to return the title of the youtube page

[DarkWater]

Oh, it's a youtube page. 

 

$begin = strpos($str, "<title>");

$end = strpos($str, "</title>");

$title = substr($str, $begin+7, $end);

 

That works for me.

[lip9000]

Sorry to be annoying, but the code just displays the youtube page, and doesn't echo out the title?? My code is:

 

$str = print readfile('http://youtube.com/watch?v=7pVmmsuuc5U');

$begin = strpos($str, "<title>");
$end = strpos($str, "</title>");
$title = substr($str, $begin+7, $end);


echo $title;

 

what's going on? Just displaying the url, no echoed title.

 

 

[BlueSkyIS]

remove the print before readfile.

[DarkWater]

Yeah, don't do $str = print readfile();

[lip9000]

$str = readfile('http://youtube.com/watch?v=7pVmmsuuc5U');

$begin = strpos($str, "<title>");
$end = strpos($str, "</title>");
$title = substr($str, $begin+7, $end);


echo $title;

 

No print before readfile still displays the whole youtube page, and still does not echo out the title!

 

I'm testing locally on WAMP, does it need to be tested live?? Or is there still something wrong with the code?

[thebadbad]

readfile() outputs a file. Use file_get_contents().

[lip9000]

ahhh cheers mate, got it working :D:D