Help with scraper for spider

[Joeker]

I'm working on a simple search engine, but I am having a problem with the scraper I wrote.

 

All I want to do is get the page using file_get_contents and insert the title content into my database.

 

The problem is, since its scraping so many pages the script is timing out or not scraping properly.

 

Heres my code:

 

<?php

set_time_limit(0);

$dbhost = "localhost"; 
$dbuser = "*****";
$dbpass = "*****";
$dbname = "*****";

mysql_connect($dbhost, $dbuser, $dbpass);
mysql_select_db($dbname);

function get ($a,$b,$c)
{
$y = explode($b,$a);
$x = explode($c,$y[1]);

return $x[0];
}

for ($i = 1; $i <= 1000000; $i++) 
{
$content = file_get_contents("http://www.website.com/page.php?id=$i");

$title = get($content, "<title>", "</title>");

mysql_query("INSERT INTO spider (title) VALUES ('$title')");
}

?>

 

Anyone?

[The Little Guy]

with a script like this, you should really have it running through command line.