webtuto Posted July 7, 2009 Share Posted July 7, 2009 hi i made a music website http://www.zik4.com and instead of taking MP3 links from other websites MANUALLY , i like to send a bot and collect MP3 and informations about that MP3 automatikely any API or something ? thanks in advance Quote Link to comment Share on other sites More sharing options...
mattal999 Posted July 7, 2009 Share Posted July 7, 2009 Well, you have 2 options. Get a web crawler and adapt it to your needs (Trust me. Not a good idea.). Or Write one yourself. (This is what I did). If you would like to see what the outcome of my own self-coded MP3 crawler, go here. The crawler consists of 4 scripts running from cron. Quote Link to comment Share on other sites More sharing options...
webtuto Posted July 7, 2009 Author Share Posted July 7, 2009 but i dont know how to code my own crawl any simple tutorial ? Quote Link to comment Share on other sites More sharing options...
mattal999 Posted July 7, 2009 Share Posted July 7, 2009 Try this: http://vision-media.ca/resources/php/create-a-php-web-crawler-or-scraper-5-minutes Quote Link to comment Share on other sites More sharing options...
webtuto Posted July 7, 2009 Author Share Posted July 7, 2009 and by the way , on you website , you dont have enough music ^^ try to upgrade ur crawler or something Quote Link to comment Share on other sites More sharing options...
mattal999 Posted July 7, 2009 Share Posted July 7, 2009 and by the way , on you website , you dont have enough music ^^ try to upgrade ur crawler or something Lol, I only coded it like a week ago, and have been making tweaks as it goes along. It currently crawls at about 500 MP3s an hour, give or take 100. I have had some problems with hosting, so I only actually have it running like an hour a day. Plus I havent integrated the cron yet, I have to run it in the browser on a meta refresh :-\ Quote Link to comment Share on other sites More sharing options...
webtuto Posted July 7, 2009 Author Share Posted July 7, 2009 check the PRIVATE MESSAGE i just sent you , it might be interesting for you Quote Link to comment Share on other sites More sharing options...
webtuto Posted July 8, 2009 Author Share Posted July 8, 2009 good Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.