Robots.txt:

Hello,

I apologize for the issue you are facing with your robots.txt file and the error in Google PageSpeed Insights. It seems like you have already tested your robots.txt file using the Robots Testing Tool, which is a great first step.

The error you are encountering, "robots.txt is not valid – Lighthouse was unable to download a robots.txt file," can sometimes occur if you are using a content delivery network (CDN) like Cloudflare. Rank Math does not create a physical robots.txt file on your site; instead, it is generated when someone visits your robots.txt URL.

You can safely ignore this error if your robots.txt file is accessible at `https://support.rankmath.com. Additionally, you might want to add the following rule to your robots.txt file to help with the PageSpeed Insights test:

Disallow: /cdn-cgi/

If you continue to experience issues, please ensure that your website cache is cleared and try testing again. If you need further assistance or if there are specific configurations you would like us to check, please reply to this ticket with your site URL, and a human agent from our support team will assist you further.

Thank you for raising this concern!

Sources:
Common robots.txt Issues & How to Fix Them » Rank Math

Hello,

Thank you for your query and we are so sorry about the trouble this must have caused.

We checked your robots.txt and it seems to be loading just fine. See screenshots below:

Please clear your website caches, including any server-level caching data, and try submitting your website to PageSpeed Insights again.

If the issue persists, please check this with Cloudflare since you indicate that Google has issues crawling it.

Don’t hesitate to get in touch with us if you have any other questions.