nirrud Posted December 21, 2010 Share Posted December 21, 2010 Hi I am presently writing a code which does the following steps given a site 1) get some keywords (written a function for it) 2) search google for these keywords (I have used curl and getURL functions for these) 3) perform keyword search in the first page of googles results. Presently I have used curl and curl_multi_getcontent but when i run the code it consumes 100% of my server. My server will not respond in this case if someone else pings. I have been trying to do pcntl_fork, but could you let me know how to optimize this code by threading and forking. I am a newbe in PHP please let me know the structure of how to invoke multiple threads and process the same. If you have someother suggestions please let me know that too. Quote Link to comment https://forums.phpfreaks.com/topic/222322-server-side-forking-and-optimization/ Share on other sites More sharing options...
nafetski Posted December 21, 2010 Share Posted December 21, 2010 What kind of server are you running? Also, what kind of load are you expecting? Are you doing 100 curl requests, or 5? Quote Link to comment https://forums.phpfreaks.com/topic/222322-server-side-forking-and-optimization/#findComment-1150017 Share on other sites More sharing options...
nirrud Posted December 21, 2010 Author Share Posted December 21, 2010 I am using a apache2, mysql, php server. I would be requesting about 100 + searches at a time when given one url. Quote Link to comment https://forums.phpfreaks.com/topic/222322-server-side-forking-and-optimization/#findComment-1150032 Share on other sites More sharing options...
BlueSkyIS Posted December 21, 2010 Share Posted December 21, 2010 be forewarned: unless you are using proxy servers or you can distribute the queries among various ip addresses or locations, google will block you with that kind of traffic. Quote Link to comment https://forums.phpfreaks.com/topic/222322-server-side-forking-and-optimization/#findComment-1150040 Share on other sites More sharing options...
nirrud Posted December 21, 2010 Author Share Posted December 21, 2010 Thank you for letting me know about it. but this just a home server and tying it as a project. So could you let me know what I could do ? Quote Link to comment https://forums.phpfreaks.com/topic/222322-server-side-forking-and-optimization/#findComment-1150043 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.