Sitemap error

#353608
  • Resolved awnssauns
    Rank Math free

    Mt site map shows the “couldn’t fetch” in google console and the error is “Blocked by robots.txt”. I have indexed all my pages, I have purged the cache. I have Configured My Sitemap saved changes and saved setting permalinks. I used the XML Validation Results and got a positive result then I ran it again and it says there errors the error is:
    Errors
    Incorrect http header content-type: “” (expected: “application/xml”)
    It’s a new site and wondering if that has anything to do with it?
    Any ideas?

Viewing 14 replies - 1 through 14 (of 14 total)
  • Azib Yaqoob
    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    Kindly share your website URL so that we can investigate this issue and offer a solution.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Should I rename my sitemap?

    Azib Yaqoob
    Rank Math business

    Hello,

    Can you please follow these steps?
    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/xXXhDt

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server.
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    That should fix the issue. Please let us know if that does not. We are here to assist.

    I already flushed the Sitemap, step 1 but not step 2, can I do it again? I will be incrementing links per sitemaps to 202?

    W3 Total Cache is not allowed on my WordPress can I do it with a different plugin?

    Prabhat
    Rank Math agency

    Hello,

    I already flushed the Sitemap, step 1 but not step 2, can I do it again? I will be incrementing links per sitemaps to 202?

    Yes, you can increase the value to 202.

    W3 Total Cache is not allowed on my WordPress can I do it with a different plugin?

    You need to exclude the sitemaps from any caching plugin that you’re using (and any server-side caching as well). You do not need to install the caching plugins mentioned in the guide shared by my colleague, you just need to exclude them from any existing caching service on the website.

    However, I checked the robots.txt file of the website and the sitemaps URL that you’ve mentioned is getting served from a CDN and returning a white page. You can have a look at the screenshot in the sensitive data section of this ticket.

    Please update the sitemap URL in the robots.txt to the actual URL from the website i.e, your-domain.com/sitemap_index.xml. Please replace your-domain.com with the actual domain.

    If you’re using Rank Math’s robots.txt, then you can follow this guide to edit it: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

    I also tested the variations of the sitemaps with https://httpstatus.io/ and 3 variations are returning 200 status. I’ve added a screenshot in the sensitive data section.

    Except for the preferred variation (which should return only a 200 status), all the non-preferred variations of the website should redirect to the preferred variation and return a 301 and 200 status.

    Please follow the steps in this link:
    https://rankmath.com/kb/couldnt-fetch-error-google-search-console/#5-check-for-the-correct-version-of-the-sitemap and redirect to the correct variation.

    You can also get in touch with your web host regarding this.

    Once done, clear your website’s cache and wait for Google to crawl the website again and see if that fixes the issue.

    Hope this helps.

    Thank you.

    none of these worked, I dont know if I did them right either. I increased the numbers links in the sitemap setting, saved in the permalink settings, omitted the URL in nitropack caching, added the code to my htaccess file, purged the cache, reconfigured my sitemap files, and added the code to my robot.txt file.
    I put my website through a robot.txt file examiner and it says
    User-agent: *
    Allow: /wp-admin/admin-ajax.php
    Disallow: /wp-admin/
    Disallow: /

    Sitemap: https://ainesaundersphotography.ca/sitemap.xml
    Sitemap: https://ainesaundersphotography.ca/sitemap.rss

    Anas
    Rank Math business

    Hello,

    I checked the sitemap, the URLs are still not redirecting to the final variation.

    If you have already modified the .htaccess file, please clear the cache from Nitropack and check the variations with https://httpstatus.io/

    If the issue persists, please get in touch with your web host and ask them to redirect to a final variation.

    Hope that helps.

    Looking forward to helping you.

    what exactly should I ask my hosting company to do?
    I dont know what my problem is anymore?

    I am also curious as to how this issue occurred?

    Anas
    Rank Math business

    Hello,

    This happens when the URLs are not redirected to a single variation.

    You can ask your web host to redirect the URLs to a preferred variation.

    You can share this link with them:
    https://rankmath.com/kb/couldnt-fetch-error-google-search-console/#num-5-4-redirect-all-three-other-versions-to-your-preferred-variation

    Hope that helps.

    Thank you.

    This wasn’t the issue- my sitemap name was wrong. I think I selected something in rank math set up installation to have change it(?) I entered the new sitemap url to the google console and got a success message.

    Hello,

    Rank Math’s sitemap doesn’t change and we don’t have the option of that. We use the name sitemap_index.xml and if you are using sitemap.xml, it will only redirect to sitemap_inde.xml which Google should also accept.

    Could you please let us know if this resolves the issue?

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 14 replies - 1 through 14 (of 14 total)

The ticket ‘Sitemap error’ is closed to new replies.