Jeffro Posted January 9, 2012 Share Posted January 9, 2012 Not sure if this is possible, but.. As most of you likely know, if a person searches Google, they can see how many webpages are indexed by using: site:techcrunch.com Is there any way that I could do this via a php script for 10 different sites and then have the results emailed to me on a daily basis? I'm not asking for a coded solution.. just an idea on how this might be achieved, if it could? Thanks. Quote Link to comment https://forums.phpfreaks.com/topic/254675-is-there-a-way-i-could-run-a-php-script-to-check-for-pages-indexed-in-google/ Share on other sites More sharing options...
QuickOldCar Posted January 9, 2012 Share Posted January 9, 2012 You can use google's search query api. But I'm pretty sure they have a max 64 results per query for their api's. I think would have to make yourself a scraper to do it properly, and even then, they only display x amount of results and then by date. While google may have no problem scraping your site continuously, they certainly will when you try and scrape them back. Here's an idea. Cycle through all your links, and for each link... check if the link exists at google or not through their search query api, save and tag the results into a database. Quote Link to comment https://forums.phpfreaks.com/topic/254675-is-there-a-way-i-could-run-a-php-script-to-check-for-pages-indexed-in-google/#findComment-1305922 Share on other sites More sharing options...
Jeffro Posted January 9, 2012 Author Share Posted January 9, 2012 You can use google's search query api. But I'm pretty sure they have a max 64 results per query for their api's. I think would have to make yourself a scraper to do it properly, and even then, they only display x amount of results and then by date. While google may have no problem scraping your site continuously, they certainly will when you try and scrape them back. Here's an idea. Cycle through all your links, and for each link... check if the link exists at google or not through their search query api, save and tag the results into a database. Thanks! Seeing if I'm still indexed is actually the primary goal here so if I could accomplish what you said, it would serve the purpose perfectly. I've never messed with Google's API before.. I'm off to check it out.... Quote Link to comment https://forums.phpfreaks.com/topic/254675-is-there-a-way-i-could-run-a-php-script-to-check-for-pages-indexed-in-google/#findComment-1305947 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.