sitemap unreadable search console

#404968
  • Resolved Mark Hoffmeister
    Rank Math free

    Hi I hope you can help. This site started off a a working copy of flexitmg.com. It was at this addresss flexitmg.webdesigntraverse.com – I installed rankmath at this point – I believe I left the check mark in “discourage search engines” in WordPress.

    I decided to make the site live by changing the IP address in the settings in cloudflare to my server address. after that I discovered that search engine were sill disabled and I fixed that.

    Then we made the pages SEO green. Now I’m trying to submit a sitemap but it says (google) cant fetch. please advise. let me know if you need credentials.

Viewing 10 replies - 1 through 10 (of 10 total)
  • [Moved to sensitive data section]

    Anas
    Rank Math business

    Hello,

    Thank you for contacting Rank Math, and sorry for any inconvenience caused.

    I checked the sitemap URLs with https://httpstatus.io/, and all variations of the sitemap are returning 200 status.
    200 status

    Please follow this guide and redirect to a final variation:
    https://rankmath.com/kb/couldnt-fetch-error-google-search-console/#num-5-4-redirect-all-three-other-versions-to-your-preferred-variation

    Once done, clear your website cache and remove all the sitemaps and submit sitemap_index.xml in the Search Console.

    Hope that helps.

    Thank you.

    I will work on getting 3 of the names redirected to the s /www version. How do I remove all site maps and robots etc?

    Thanks

    Anas
    Rank Math business

    Hello,

    To remove the sitemap, click on the sitemap, then click on the three dots, you will then get an option to remove the sitemap:
    robots

    For the robots.txt, you only need to make sure that the file is not blocking any crawlers.

    We recommend using the default robots.txt rules:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://yoursite.com/sitemap_index.xml

    Replace yoursite.com with your domain name.

    Here is a guide you can follow to edit the robots.txt file:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

    Hope this helps.

    Looking forward to helping you.

    This is a cpanel server self hosted running ngix (recently added) my tech guy wonders if there are different instructions for cpanel. and can we add my tech J*****@t************** to this thread. I’ve been at this a week on and off. Thanks

    Prabhat
    Rank Math agency

    Hello,

    As it is running NGINX, you can follow this guide: https://www.digitalocean.com/community/tutorials/how-to-redirect-www-to-non-www-with-nginx-on-centos-7

    However, I accessed your website as Googlebot and the entire website (not only the sitemap) is returning a 403 Forbidden error. Please have a look at the screenshot in the sensitive data section of this ticket.

    Please ensure that the website and sitemaps are fully accessible to Googlebot and not getting blocked by any firewall or similar services.

    Further, wait for Google to crawl the website again and see if that helps.

    Thank you.

    >>Please ensure that the website and sitemaps are fully accessible to Googlebot and not getting blocked by any firewall or similar services

    This is why I have contacted you. How do I correct this situation exactly – do you have any steps I can take

    I’m asking you because I’ve got RankMath installed and I like the results – but this must have something to do with rankmath and the bots or sitemaps produced – Im not experiencing this on 40 other sites on this server? Thank You for any guidance at all. I am stuck. Do not know what to do!

    I asked and for your to successfully run and emulated google bot I will have to whitelist your IP.

    Can you get me that info then try it again? Thanks in advance. If I have to buy rank math I will I just need to figure out why this site is being blocked and how? (by who?)

    Here is what Imunify 360 said:

    Taras Yasinsky (CloudLinux)
    Jun 15, 2022, 22:28 GMT+3
    Hi Mark,

    Indeed blocking fake / emulated Googlebot accesses normally result in blocking with Imunify360, and to do SEO testing it would be necessary to whitelist the IP address from which the test accesses are made in regular and RBL white lists:

    imunify360-agent whitelist ip add 111.222.33.44
    imunify360-agent create-rbl-whitelist
    Should you require our further attention to this or any other matter, please let us know.

    Kind Regards,
    Taras Yasinsky | Unified Support | Support Engineer
    Try free: http://cloudLinux.com | http://kernelcare.com | http://imunify360.com
    Get 24/7 free technical support at: https://cloudlinux.zendesk.com/
    Follow https://twitter.com/CloudLinuxOS for technical updates

    Hello,

    You don’t need to whitelist the IP as I can check Googlebot is able to access your site but all four versions of your sitemap are still retuning a 200 status:

    Please get in touch with your host and ask them to redirect all the versions of the sitemap to your preferred version. Once done, clear the cache of your site, remove all previously submitted sitemaps from your GSC account, and resubmit your main sitemap(sitemap_index.xml).

    Let us know how that goes. Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘sitemap unreadable search console’ is closed to new replies.