arathi Posted January 24, 2008 Share Posted January 24, 2008 hi I'm in the process of developing a online sitemap generator tool using php. I've studied all the necessary prototypes and the requirements for the tool. But i couldn't come to a conclusion on the algorithm the tool should be using for crawling.. What would be the be the best algorithm (for searching and adding links) for the crawler program? Please help me with this.. Quote Link to comment Share on other sites More sharing options...
pdkv2 Posted January 24, 2008 Share Posted January 24, 2008 Do u want board to create the algorithm for you ? Quote Link to comment Share on other sites More sharing options...
rajivgonsalves Posted January 24, 2008 Share Posted January 24, 2008 its as follows 1) find all the links on the page 2) recurse through all links to a certain level its pretty simple and easy.. 3) keep adding the links to a unique array.. Thats it atleast what I can think off if you read about a crawler you should have no problems at all.. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.