Hello,
I’m sorry to hear that you’re experiencing issues with the robots.txt and sitemaps. It seems like there might be some conflicts causing the 404 errors.
To address the robots.txt issue, you can start by checking if there’s another robots.txt file in your site’s root directory. If there is, you should delete it and clear your website and server-level cache. You can also try adding the applicable rewrite rule to the .htaccess file on your site.
As for the sitemap issues, you can ensure that you’ve submitted the correct XML sitemap to Google. If you’re sure you’ve submitted the correct URL and are still facing errors, you can check for plugin conflicts using the Health Check plugin. Additionally, if your sitemap URL is blocked by robots.txt, you should make sure there are no unintended rules in your actual robots.txt file or the virtual robots.txt file added by Rank Math.
If these steps don’t resolve the issues, please feel free to reach out to our support team directly from here, and we’re always here to help.
Regarding the server stress issue, it’s possible that it might be related to the occasional 404 codes. However, if you’re still experiencing these issues, it would be best to contact your web hosting provider for assistance.
I hope this helps! If you have any further questions or need additional assistance, please don’t hesitate to ask.
Sources:
How to Fix the ‘Blocked Due to Other 4xx Issue’ Error » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
Rank Math Sitemap Issues and Their Fixes » Rank Math
Solving Redirection Issues Using Rank Math SEO Plugin » Rank Math
I’ve enabled again 404 Monitor. Maybe I’ve troubles with hosting. I’ll use your tool only to discover their troubles.
Hello,
Thank you for your patience.
In this case, we also recommend getting in touch with your web host to check for any server issues regarding your robots.txt or other file accessibility.
Moreover, please note that we only report the 404s. We do not have information on how or why they are generated.
Looking forward to helping you.
Staging site generated url on live sitemaps…. I hope to have any troubles.
Hello,
If you experience any trouble with this, please don’t hesitate to reach out again. We’ll be happy to help you with it.
Thank you for choosing Rank Math.
