rockSteady Posted January 18, 2009 Share Posted January 18, 2009 I'm currently building an adult site which is php based, but I've ran into a little issue I'd like to get resolved. I tried create a sitemap for my site the other day but it seems the generator I used only indexes the first page which pops up (an age verification & disclaimer page) which makes me suspect that search engine spiders might not be able to fully crawl through my site either. Is there any way I can make it more accessible? Thanks! Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/ Share on other sites More sharing options...
premiso Posted January 18, 2009 Share Posted January 18, 2009 I'm currently building an adult site which is php based, but I've ran into a little issue I'd like to get resolved. I tried create a sitemap for my site the other day but it seems the generator I used only indexes the first page which pops up (an age verification & disclaimer page) which makes me suspect that search engine spiders might not be able to fully crawl through my site either. Is there any way I can make it more accessible? Thanks! Have a hidden link on your site that goes to the sitemap or somewhere on your site so only bots would pick it up. Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/#findComment-740021 Share on other sites More sharing options...
dropfaith Posted January 18, 2009 Share Posted January 18, 2009 not sure if this helps but it might be the generator as well i use this one www.xml-sitemaps.com and never have issues Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/#findComment-740024 Share on other sites More sharing options...
rockSteady Posted January 18, 2009 Author Share Posted January 18, 2009 xml-sitemaps.com is the one I've been trying to get to work but it only index's my validuser.php which is the first page thats pulled up and requires you to enter in a valid birthday (18+) in order to gain access to the site. Is there a way for me to let the sitemap generator/search engine spiders bypass this? Thanks again! Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/#findComment-740032 Share on other sites More sharing options...
dropfaith Posted January 18, 2009 Share Posted January 18, 2009 not really other then get the spider to start past that page ie disclaimer.php enter a valid date index.php ( set the sitemap gen to start looking from here) spiders cant crawl thru forms and submitted data and never will Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/#findComment-740035 Share on other sites More sharing options...
premiso Posted January 18, 2009 Share Posted January 18, 2009 I'm currently building an adult site which is php based, but I've ran into a little issue I'd like to get resolved. I tried create a sitemap for my site the other day but it seems the generator I used only indexes the first page which pops up (an age verification & disclaimer page) which makes me suspect that search engine spiders might not be able to fully crawl through my site either. Is there any way I can make it more accessible? Thanks! Have a hidden link on your site that goes to the sitemap or somewhere on your site so only bots would pick it up. Give that a try and see what happens. Basically the link would bypass the validation and since a bot will see it they will crawl it, an since it is "hidden" the users will never see it and click on it and thus your disclaimer still stands etc. If you require a session string to view the site I would change that cause bots will not store session data due to lack of cookies. Link to comment https://forums.phpfreaks.com/topic/141381-search-engines-verification-page/#findComment-740039 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.