Sitemap 403 error

#618177
  • Resolved Amit Chaudhary
    Rank Math free

    Hi,

    I’m getting 403 error for the page-sitemap.xml. Rest of the post & web stories sitemaps are without any errors. How to rectify this problem?Search Console Error Error in GSC

    Website: famoustarz

Viewing 13 replies - 1 through 13 (of 13 total)
  • Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    We have checked your sitemap and we can confirm that it is working correctly. We can access your sitemap without any errors and we can see all the URLs that you have included in it. You can see a screenshot of your sitemap here: sitemap

    Please try following the steps below to see if that works for you:

    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/pipRDp

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    Once done, clear your website cache and resubmit the /sitemap_index.xml in the Search Console.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Thanks for your reply.

    I followed all the steps given above. Still I’m getting 403 error for page-sitemap.xml in google search console. Also, I can see that google last crawled all the page on my website on 26th July 2023.

    I forgot to add in my previous reply, that after I switched from Ezoic to adsense 10 days back, half of my webpages are indexed in non WWW version. Whereas, rest of the pages are indexed in the WWW version which is the correct one. I have already placed 301 for the non WWW in .htaccess. Still the issue isn’t resolved.

    Hello,

    Thank you for your patience.

    Upon checking your sitemaps, the Google bots indeed get a 403 error on your sitemaps. You can also use this tool to verify that: https://httpstatus.io/

    403

    By default, Cloudflare is set to bypass known bots like Googlebot, but sometime this might not be the case – Cloudflare may be restricting Googlebot access intermittently. To fix this try finding which Cloudflare service is blocking Googlebot.

    In this case, visit your Cloudflare Dashboard > Security > Events and filter events using Googlebot’s user agent (or part of it), IP addresses, etc. Once you find events where Googlebot is being blocked you can modify the relevant settings to prevent this from happening.

    If the issue still persists, please check with your web host if the ModSecurity (ModSec) feature is enabled on your server as it is possible that it is blocking bots to crawl your sitemaps.

    Regarding the non-WWW version, if those URLs were already indexed and showing on the search results, then you may need to give Google some time to recrawl the URLs and update the version on the search results page.

    Let us know how this goes.

    Hi,

    I just checked the sitemap and page sitemap on https//:https.io/ and got no error. I’m attaching screenshot for your reference. Also I’m not using cloudflare for this website. Previously I was using cloudflare. After I shifted to Ezoic I removed the cloudflare integration. Currently, I’m not using Ezoic or clouldflare.

    No Error

    Update

    I spoke with the web hosting, according to them modsecurity isn’t blocking google bot.

    Hello,

    We tried visiting your website to check the issue further but it seems it is showing an origin error on my end. See the screenshot in the sensitive data section.

    Can you please verify this on your end?

    Looking forward to helping you.

    Hi,

    My website and sitemap are accesible without any errors at my end. I also check at https://httpstatus.io/ and got no errors.

    Hello,

    Thank you for getting back to us.

    We just checked again and it looks like your sitemap is throwing a 404 error. See the screenshot:

    To resolve this, you should flush and regenerate your sitemap. Follow these steps:

    • Reset your WordPress permalinks by going to WordPress Dashboard > Settings > Permalinks and clicking Save Changes without making any changes.
    • Regenerate your sitemap by going to Rank Math > Sitemap Settings and changing the Link per Sitemap to 201 or anything else and then click Save Changes. You can change it later, this is just to regenerate your sitemap. You can follow this screencast: https://i.rankmath.com/pipRDp
    • Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
      https://rankmath.com/kb/exclude-sitemaps-from-caching/

    Learn more about this error and more ways to rectify it here: https://rankmath.com/kb/sitemap-404-error/

    If none of these steps resolve the issue, please let us know and provide us with your WordPress login details and FTP access in the Sensitive Data section so we can take a closer look.

    We hope this helps. Please let us know if you have any questions or concerns.

    Thank you for choosing Rank Math!

    Hi,

    The problem solved on its own after I reinstalled the website from the backup. Today, I checked the page-sitemap.xml in the search console, it has no errors. Anyways, thanks for your help.

    I just wanted to know, due to the error mentioned above, some of my webpages with non WWW version are indexed in the search console. How do I remove them? Or Will Google remove them after some-time?

    Thanks

    Marlow
    Rank Math free

    Hello,

    Glad to know that the sitemap issue was resolved.

    As for the other question, Google will remove these non-WWW versions since it’s not found on your website anymore or is being properly redirected. A fair bit of warning though, it may take Google days or weeks to recrawl the website.

    Hope that helps and please do not hesitate to let us know if you need my assistance with anything else.

    Thanks Marlow.

    Hi there,

    We’re delighted to hear that this issue has been resolved. We appreciate your kind words and your support.

    I’m closing this ticket now but if you ever have another question or need any help in the future, please don’t hesitate to create a new forum topic. We’ll be more than happy to assist you again.

    Thank you for choosing Rank Math and have a wonderful day!

    Cheers

Viewing 13 replies - 1 through 13 (of 13 total)

The ticket ‘Sitemap 403 error’ is closed to new replies.