eaglehopes Posted June 30, 2022 Share Posted June 30, 2022 Hello to everybody, I need critiques and "website crawling help" about my website http://enginery.freecluster.eu . My crawling question was that: I tried google search console tools to add my website's sitemap and add it : http://enginery.freecluster.eu/sitemap.xml . It says my sitemap is ok and found 312 pages but not crawl all correctly! Three weeks have passed but nothing changed. I manually request indexing some pages(about 4 pages) and google search console, after than today it only shows some of them(not all 4) when I search using "site:http://enginery.freecluster.eu". My website's all files have php extensions. Did this prevent googlebot to reach the content of my websites' pages? My robots.txt file's content is : User-agent: Googlebot Allow: / User-agent: * Allow: / Sitemap: http://enginery.freecluster.eu/sitemapv1.xml Any critiques and help is appreciated. Thanks. Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/ Share on other sites More sharing options...
eaglehopes Posted June 30, 2022 Author Share Posted June 30, 2022 Sorry, i wrote wrong my sitemap address in robots.txt , it should be : http://enginery.freecluster.eu/sitemap.xml. Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/#findComment-1597766 Share on other sites More sharing options...
requinix Posted June 30, 2022 Share Posted June 30, 2022 There's whitespace around the URLs. <loc> http://enginery.freecluster.eu/index.php </loc> It's a minor thing but could be a problem. Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/#findComment-1597770 Share on other sites More sharing options...
eaglehopes Posted June 30, 2022 Author Share Posted June 30, 2022 Thanks requinix, I corrected it. 🙂 Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/#findComment-1597772 Share on other sites More sharing options...
eaglehopes Posted July 4, 2022 Author Share Posted July 4, 2022 Hi again, I noticed that, some CSS graphical coding in my web page cause high GPU usage so I remove all CSS patterns. So it will become very simple and fast in terms of loading speed. I used small sized images for thumbs which increase speed too. I also changed my website's xml sitemap; this time I only used folder based page locations, not using query types(i.e using & etc.) , maybe this time search engines will crawl my pages, I hope Since still there seems a excluded $ of pages are 307 which is nearly the 95% of the whole site... Eagle hopes that Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/#findComment-1597957 Share on other sites More sharing options...
eaglehopes Posted July 29, 2022 Author Share Posted July 29, 2022 I noticed that, my sitemap contains other mistakes as well : https://developers.google.com/search/docs/advanced/sitemaps/build-sitemap?hl=en#general-guidelines I have not use "www" in "url"s because I do not know it. I corrected them too. I hope, this time google will start to crawl my page Quote Link to comment https://forums.phpfreaks.com/topic/314981-need-critiques-and-indexing-crawling-help/#findComment-1598766 Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.