robots.txt fetch

Hello,

Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

It happens when you have a robots.txt file in your root folder in this case Rank math cannot generate the virtual robots.txt.

Please login to your site cPanel and head to file manager, find the robots.txt file and delete or rename it. That should fix your issue. You can test your robots.txt here: https://technicalseo.com/tools/robots-txt/

Looking forward to helping you.

Thank you.

Hello,

Thank you for getting in touch with us.

If there is no robots.txt file in your root folder and as you are getting 200 ok status then don’t need to worry. Please note that the couldn’t fetch error is quite common and it normally goes away after a few days. Please clear your website cache and then let us know how this goes after about 3 days.

Hope this helps you. Please do not hesitate to let us know if you need our assistance with anything else.

Thank you.

Hello,

I accessed the robots.txt file on your website as Googlebot and there are no issues found. 200 (OK) status is returned.

Sure, please clear your website’s cache and wait until Google crawls the website again and see if that fixes the issue.

I also suggest you keep an eye on the coverage section of your Google Search Console account to see if any errors are shown.

Looking forward to hearing back from you.

Thank you.

Hello,

I checked the robots.txt file again, it is loading fine:

On the robots.txt tester page, add any URL of your website and test:

Do note that robots.txt tester tool is a legacy tool that does not yet have a full replacement in the new Search Console so there might be some issues with the tool.

I hope this helps. Looking forward to helping you.