arathi Posted January 24, 2008 Share Posted January 24, 2008 hi I'm in the process of developing a online sitemap generator tool using php. I've studied all the necessary prototypes and the requirements for the tool. But i couldn't come to a conclusion on the algorithm the tool should be using for crawling.. What would be the be the best algorithm (for searching and adding links) for the crawler program? Please help me with this.. Link to comment https://forums.phpfreaks.com/topic/87526-algorithm-for-sitemap-generation-tool/ Share on other sites More sharing options...
pdkv2 Posted January 24, 2008 Share Posted January 24, 2008 Do u want board to create the algorithm for you ? Link to comment https://forums.phpfreaks.com/topic/87526-algorithm-for-sitemap-generation-tool/#findComment-447671 Share on other sites More sharing options...
rajivgonsalves Posted January 24, 2008 Share Posted January 24, 2008 its as follows 1) find all the links on the page 2) recurse through all links to a certain level its pretty simple and easy.. 3) keep adding the links to a unique array.. Thats it atleast what I can think off if you read about a crawler you should have no problems at all.. Link to comment https://forums.phpfreaks.com/topic/87526-algorithm-for-sitemap-generation-tool/#findComment-447674 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.