Smudged123 Posted February 4, 2009 Share Posted February 4, 2009 I run a site which has a age verification splash page that displays itself if the user doesn't have the certain cookie. I'm having trouble creating a sitemap that indexes my full site because it seems to index only my age validation page and I'm guessing this crawling issue extends further to search engine spiders not being able to properly index my site fully. Is there any cure for this? Thanks! Link to comment https://forums.phpfreaks.com/topic/143849-problem-with-pages-not-being-accessible/ Share on other sites More sharing options...
Brian W Posted February 4, 2009 Share Posted February 4, 2009 Can they skip this page if they just go strait to the page they want or do you force them to answer it? Link to comment https://forums.phpfreaks.com/topic/143849-problem-with-pages-not-being-accessible/#findComment-754824 Share on other sites More sharing options...
Smudged123 Posted February 4, 2009 Author Share Posted February 4, 2009 It's forced to be answered Link to comment https://forums.phpfreaks.com/topic/143849-problem-with-pages-not-being-accessible/#findComment-754842 Share on other sites More sharing options...
Brian W Posted February 4, 2009 Share Posted February 4, 2009 I think in the robots.txt you can define pages you want the robots to go. Send them first to a page that is buried a little that will set the sessions/cookies as though it had provided a valid age then send the bot back to your home page. Hope that helps Link to comment https://forums.phpfreaks.com/topic/143849-problem-with-pages-not-being-accessible/#findComment-754850 Share on other sites More sharing options...
Smudged123 Posted February 5, 2009 Author Share Posted February 5, 2009 I had been told that Search Engine spiders aren't able to store cookies so would this robots.txt method work? If so, please let me know! Link to comment https://forums.phpfreaks.com/topic/143849-problem-with-pages-not-being-accessible/#findComment-755317 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.