ranjan Posted April 30, 2008 Share Posted April 30, 2008 Hi All, I want to make a website crawler in php...but before delving into the coding I prefer to have a open-source website crawler in php-mysql platform (if there is anything available). Anyone there to give light in this topic? Thank you all in advance Link to comment https://forums.phpfreaks.com/topic/103549-php-website-crawler/ Share on other sites More sharing options...
thebadbad Posted April 30, 2008 Share Posted April 30, 2008 I've made a few simple crawlers myself, using mainly file_get_contents() and RegEx. But if you want to go the more advanced way, cURL could be the answer. What do you want to do with it? Crawl one page and return something specific, or maybe more pages? Also, a Google search for 'php crawler' can be of help. Link to comment https://forums.phpfreaks.com/topic/103549-php-website-crawler/#findComment-530270 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.