Hello,
Thank you for contacting us and we regret the inconvenience you’re facing.
I checked the URLs that you’ve shared and they’re already set to Index. Please have a look at this screencast for a quick reference: https://i.rankmath.com/pbIlMQ
However, I was able to replicate an error in the sitemaps on your website. Here’s a screenshot: https://i.rankmath.com/Czb8WX
Please follow the below steps and see if that helps:
1. Flush the Sitemap cache by following this video screencast:
https://i.rankmath.com/pipRDp
2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
https://rankmath.com/kb/exclude-sitemaps-from-caching/
3. Clear your website and browser’s cache and check the sitemaps if they load properly.
If the issue persists, assuming you are using the latest version of all the plugins and the themes (please update if not yet), it would seem like a conflict with one of the plugins or the theme you are using.
To determine that, please follow this troubleshooting guide:
https://rankmath.com/kb/check-plugin-conflicts/
Here is a video you can follow as well: https://www.youtube.com/watch?v=FcIWRhcUP2c
Only the site admin would know and your users won’t be affected by this troubleshooting.
Let us know how that goes.
Thank you.
Hi Prabhat,
I’m not getting the error you mentioned on the sitemap. As soon as I cleared my Cloudflare cache, the 404 errors also stopped. I have now added the line of code to the WP Rocket cache settings as mentioned in the article you shared. Hopefully that resolves the problem.
Chintan
Hello,
I checked the sitemaps again and the error is still visible. You can have a look at this screencast for a quick reference: https://i.rankmath.com/bGaA3Q
If you wish, we can have a closer look to get to the bottom of the issue. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.
Please do take a complete backup of your website before sharing the information with us.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
We really look forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Sorry for the delay. I created a new admin account and shares its details with you. Can you please check now?
Hello,
I can check that your sitemap is working fine and the URLs that you had shared are also set as index. Let us know if you are still facing any issues with the sitemap or the URLs.
Looking forward to helping you.
Thanks.
Hi Jaideep,
Thanks much for checking that. Can you please help me with understanding why Ahrefs webmaster tool crawl always reveals a new set of URLs getting noindex and nofollow by themselves? Here’s a current screenshot: https://ibb.co/dBt6yyw.
This is the same kind of error I encountered with other URLs when I started this thread. It seems like all of those URLs are working fine right now for me, but why is such an error popping up repeatedly? For the last time this happened, my hosting company said it could have to do with Elementor. What do you think?
Hello,
I checked the source of the URLs and they’re already set to Index and Follow. Here’s a screencast for a quick reference: https://i.rankmath.com/RNIJjx
The URLs are also present in the sitemaps.
Please clear your website and server’s cache and test the website again and see if that helps.
If the issue persists, please get in touch with Ahrefs support regarding this as the correct meta robots settings are already applied on the pages.
Hope this helps.
Thank you.
Okay now Google Search Console has raised a new URL that it says has been set to noindex: https://ibb.co/P6vWzTN. And that URL (which is: https://elitecontentmarketer.com/make-money-writing/) is giving me a 404. These issues have been repeatedly happening since I’ve switched from Yoast to RankMath, and my hosting. What do you people think can be responsible for these errors that keep happening on new URLs?
Hello,
I can check that the URL is accessible and also set as index. Can you please validate the fix in your GSC account and wait for Google to crawl the URL again?
The issue should be resolved after that. And if you keep facing the 404 errors for the URLs that are present on your site then you should get in touch with your host to figure out what is causing the issue.
Let us know how that goes. Looking forward to your update.
Thanks.
