Hello,
We apologize for the issue you are facing with editing your robots.txt file on your staging site. Unfortunately, the warning you are seeing indicates that Rank Math requires the search engine visibility to be set to Public in order to make changes to the robots.txt file.
To allow SEMRush to audit your site without changing the search engine visibility to Public, you have a couple of options:
-
Temporarily Change Visibility: If possible, you could temporarily change the search engine visibility to Public, make the necessary edits to your robots.txt file, and then revert it back to Hidden after the audit is complete. This is the most straightforward method.
-
Use a Physical robots.txt File: If you have access to your site’s root directory, you can create or edit a physical robots.txt file directly via FTP or cPanel. This way, you can add the necessary rules without needing to change the settings in Rank Math. However, please note that if a physical robots.txt file exists, it may override the virtual one created by Rank Math.
-
Contact Your Hosting Provider: If you’re unable to make these changes yourself, consider reaching out to your hosting provider for assistance. They may be able to help you edit the robots.txt file directly.
If you need further assistance or have any other questions, please feel free to reply to this ticket, and a human agent from our support team will assist you further. Thank you for raising this concern!
This is an automated reply from Rank Math Support Bot. If you need further assistance, please reply to this topic and a human support agent will reply to you shortly.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
