abdus Posted August 26, 2008 Share Posted August 26, 2008 hello, my site is 3 month old now / ~100 pages , the indexing was good in the beginning it used to be increased everyday in google , but now it stopped on 40 pages since weeks , although I see googlebot crawling alot of pages in my site but they never show up in the search . the site structure is one new page everyday and a page never changed or updated -- this is actually another problem because spiders keep recrawl the pages without need . I made some changes and I think they are the mistake .. first I altered the index.php keywords .. is it ok ? also I made sitemap .. it was sitemap.php and googlebot visited it only one time but it is updated with new page everyday so I change it to archive.php and googlebot keep visiting it time to time . the questions are: 1- why the index stopped ? 2- how to tell the spider that this page wont be updated so dont visit it again .. find another one. 3- best way to make page contains every links in the site but the links increased everyday ? Quote Link to comment https://forums.phpfreaks.com/topic/121452-crawl-and-no-index/ Share on other sites More sharing options...
RalphOrange Posted August 30, 2008 Share Posted August 30, 2008 I'm not sure, but I think all sitemaps should be *.txt. In google, you can actually create an account, then upload your sitemap.txt file, and run a test on it. It won't automatically index your site, but it will tell if there are problems with the sitemap.txt file. Quote Link to comment https://forums.phpfreaks.com/topic/121452-crawl-and-no-index/#findComment-629688 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.