Hello,
I apologize for the inconvenience you are facing with your robots.txt file. The error message "robots.txt is not valid – Lighthouse was unable to download a robots.txt file" in Google PageSpeed Insights can occur when using a content delivery network (CDN) like Cloudflare.
Rank Math does not physically create a robots.txt file on your site. Instead, the file is generated and displayed when a user visits your robots.txt URL. Therefore, you can safely ignore this error if your robots.txt file is accessible at https://rankmath.com/kb/fix-common-robots-txt-issues/.
If you still encounter issues, you can optionally add the following rule to your robots.txt file and retest it in PageSpeed Insights:
Disallow: /cdn-cgi/
If you need further assistance or have any questions, feel free to reach out to our dedicated support team. You can also refer to our guide on Common robots.txt Issues & How to Fix Them for more information.
We hope this helps resolve your robots.txt issue. Thank you for bringing this to our attention.
Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
No Information is Available for This Page » Rank Math
This is an automated reply from Rank Math Support Bot. If you need further assistance, please reply to this topic and a human support agent will reply to you shortly.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
