Robots.txt error

Hello,

Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

Please enable Advanced Mode to access the Robot.txt editor as shown on this screencast:
https://i.rankmath.com/sjk8io

Please note that this will not work if you have robot.txt file present in your root folder so you need to delete it for Rank Math to generate a virtual robot.txt.

If these steps still didn’t solve your issue regarding the “Failed to fetch robots.txt file” error, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/

You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/

We really look forward to helping you.

Hello,

Sorry for the delay.

Could you also provide the affected URLs that are still not indexed for us to further check?

Thank you, and looking forward to your update.

Hello,

Thank you for keeping in touch with us.

Upon checking each of your links, there’s no issue to all of them. All links are returning 200 status, no redirects and your XML page passed the test on XML validator tools.

Can you please flush your sitemap cache by heading to WordPress Dashboard > Rank Math > Sitemap Settings > General as shown in the video screencast below:
https://i.rankmath.com/C2UQX5

After that, try to re-submit your sitemap to your Google Search Console.

Let me know how it goes.

Looking forward to helping you.

Hello,

I’ve also checked the URL’s you have provided, and it seems that they are already set to index with a 200 status code.

There are a few things you must check for to see why the posts aren’t getting indexed.

1. Make sure the post is not selected as ‘noindex’ in WP > Posts > Your Post > Advanced Tab in Rank Math.
Screenshot:

2. Ensure that the noindex is not selected for Global or Posts meta:

3. Check the sitemap settings and check if the posts are setup to be included in the sitemaps:

Please note that it is completely upto Google if they want to index or not index your website. So, if you haven’t willingly or accidentally made your posts noindex and Google still isn’t indexing your page – it means that either Google doesn’t want to index or hasn’t crawled your page yet because it hasn’t allocated that much crawl budget to your website.

Please check this website for more details.

I hope that helps and please do not hesitate to let us know if you need our assistance with anything else.