sd9sd Posted May 9, 2008 Share Posted May 9, 2008 Hi, The pages of youtube, for example, are generated by a script, right? either ajax, asp or php. My question is, that even though the page is generated dynamically, how does google find the content? Is there a way to make a dynamically generated page search engine detectable? thanks Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/ Share on other sites More sharing options...
blackcell Posted May 9, 2008 Share Posted May 9, 2008 I think it has something to do with Web Crawlers. http://en.wikipedia.org/wiki/Web_crawler As to how to get these to detect things I am not for sure if it is timed processes that happens or segments or what. Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-536631 Share on other sites More sharing options...
sd9sd Posted May 9, 2008 Author Share Posted May 9, 2008 In wikipedia, there was a mention of a web crawler slowing a site by crawling it. Could it be that they crawl a page when a person is viewing a page? That way they can read dynamically generated content, right? Could that also be the way spam bots get email id's from pages? Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-536880 Share on other sites More sharing options...
BlueSkyIS Posted May 9, 2008 Share Posted May 9, 2008 neither you nor spiders can tell php output to a browser versus plain HTML output to a browser. PHP outputs HTML from the server. When it gets to the browser (or the spider), it is HTML. Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-536883 Share on other sites More sharing options...
sd9sd Posted May 12, 2008 Author Share Posted May 12, 2008 Yes, so can we say that when the HTML shows up on the browser, the search engine crawler caches it? If the above theory holds good, then we needn't be bothered about the browser generating content dynamically, right? Coz the search engine will cache it at sometime or the other? Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-539171 Share on other sites More sharing options...
rarebit Posted May 12, 2008 Share Posted May 12, 2008 a web crawler is just an automated client, it downloads exactly the same, just doesn't show it... Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-539185 Share on other sites More sharing options...
BlueSkyIS Posted May 12, 2008 Share Posted May 12, 2008 Yes, so can we say that when the HTML shows up on the browser, the search engine crawler caches it? If the above theory holds good, then we needn't be bothered about the browser generating content dynamically, right? Coz the search engine will cache it at sometime or the other? you can say that about code that is generated on the server and sent to the browser. you can't say that about dynamic browser-side code that writes to the browser window, for example javascript/ajax or vbscript. Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-539187 Share on other sites More sharing options...
sd9sd Posted May 18, 2008 Author Share Posted May 18, 2008 Yup, that's the answer I was looking for. Thanks Link to comment https://forums.phpfreaks.com/topic/104836-solved-google-reading-php-generated-pages/#findComment-544188 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.