warnockm Posted September 14, 2006 Share Posted September 14, 2006 Does anyone know of something that's been released that spiders websites? Specifically, i want to give it a site (or a list of them) and have it spider them, staying only in that site, and download all of the documents, like .doc or .pdfs. Then return periodically and report the changes and download the new ones. Has anyone seen anything like this in PHP? i'll code it myself if i have to , but might as well not reinvent the wheel. Thanks! Quote Link to comment https://forums.phpfreaks.com/topic/20804-web-crawlerspider-update-notification/ Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.