help on making my own crawler

[webtuto]

hi , i want to make a crawler that grab IMAGES LINKS from another website

so i started like that

$site = "http://www.zik4.com/";
$file = file_get_contents($site);

 

and i dont know how to extract just IMAGES URLS(using regex but...) and echo them on my page

any idea on how to search on a source code for a word and echo it ?

thanks in advance

[webtuto]

TOP>

[WolfRage]

Start reading and enjoy.

http://www.php.net/manual/en/function.ereg.php

Don't forget to check out string functions, but this depends on how much you plan on doing this.

[webtuto]

thanks wolfrage , but i already saw this , and it return 0 , i think ididnt know how to implement it

[The Eagle]

Are you referring to grabbing images from a website? If so, try this code below.

 

if ($handle = opendir('url/')) {
while (false !== ($file = readdir($handle))) {
if ($file != "." && $file != ".." ) {
if (strpos($file, '.jpg',1)||strpos($file, '.gif',1) ) {
print"$file<br />";
}
}
}
closedir($handle);
}

[webtuto]

@THE EAGLE : i did that but where do i have to put the link to the website where the script m ust grab photos ???

 

i put the link here like that ->

$site = "http://www.zik4.com/";
if ($handle = opendir($site)) {

 

but it return this error

Warning: opendir(http://www.zik4.com/) [function.opendir]: failed to open dir: not implemented in C:\wamp\www\bot\index.php on line 3

[The Eagle]

Try adding this into the code

 

<?
$f = fopen("http://www.domainname.com","r");
$inputStream = fread($f,65535);
fclose($f);
if (preg_match_all("/<a.*? href="(.*?)".*?>(.*?)</a>/i",$inputStream,$matches)) {
$matches= strip_tags($matches);
print_r($matches);
}
?> 

[webtuto]

i used the codeeu just game and and it gaves me this error

--> Parse error: parse error in C:\wamp\www\bot\index.php on line 5

line 5 is ->

if (preg_match_all("/<a.*? href="(.*?)".*?>(.*?)</a>/i",$inputStream,$matches)) {

ps : i copied just the latest code ugave me , i deleted the first one that uses readdir

[The Eagle]

Parse errors refer to such as the href does not exist, (e.g: Make sure .*? is listed within the code)

 

I doubt this will help, but add a semicolon ( ; ) after line 5.

 

I'm still looking into this.

[webtuto]

well you can  try ur self , the website is --> www.zik4.com

[The Eagle]

register_globals 1

- ZIK4.com has this enabled, I am wondering why your script isn't working.

[JonnoTheDev]

You dont want to be using the function file_get_contents() for this job.

To create a scraper, spider, whatever you should learn CURL. Checkout the PHP manual. I would also look ad the 'tidy' funtions to clean HTML on remote sites prior to using any regular expression pattern matching as people use all kinds of variations of HTML syntax.

[seventheyejosh]

Have a peek at this. It should get you started in the right direction. It isn't simply a 3 line command to get a site's content.