abdus Posted August 26, 2008 Share Posted August 26, 2008 hello, my site is 3 month old now / ~100 pages , the indexing was good in the beginning it used to be increased everyday in google , but now it stopped on 40 pages since weeks , although I see googlebot crawling alot of pages in my site but they never show up in the search . the site structure is one new page everyday and a page never changed or updated -- this is actually another problem because spiders keep recrawl the pages without need . I made some changes and I think they are the mistake .. first I altered the index.php keywords .. is it ok ? also I made sitemap .. it was sitemap.php and googlebot visited it only one time but it is updated with new page everyday so I change it to archive.php and googlebot keep visiting it time to time . the questions are: 1- why the index stopped ? 2- how to tell the spider that this page wont be updated so dont visit it again .. find another one. 3- best way to make page contains every links in the site but the links increased everyday ? Link to comment https://forums.phpfreaks.com/topic/121452-crawl-and-no-index/ Share on other sites More sharing options...
RalphOrange Posted August 30, 2008 Share Posted August 30, 2008 I'm not sure, but I think all sitemaps should be *.txt. In google, you can actually create an account, then upload your sitemap.txt file, and run a test on it. It won't automatically index your site, but it will tell if there are problems with the sitemap.txt file. Link to comment https://forums.phpfreaks.com/topic/121452-crawl-and-no-index/#findComment-629688 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.