Hello,
We apologize for the issue you are facing with the robots.txt file on your website. It seems that remnants of the Yoast plugin’s settings are still affecting your site’s configuration even after you deleted the physical robots.txt file.
Here are a few steps you can take to resolve this issue:
-
Clear Cache: Since you mentioned that you don’t see options for clearing cache in cPanel, it would be a good idea to contact your hosting company and ask them to clear the server cache. This can sometimes resolve issues where old settings are still being referenced.
-
Check for Other Plugins: Ensure that no other plugins are creating or managing the robots.txt file. If another SEO plugin is active, it might be conflicting with Rank Math.
-
Edit Robots.txt in Rank Math: After clearing the cache, try editing the robots.txt file again through Rank Math. You can do this by navigating to Rank Math SEO → General Settings → Edit robots.txt. Make sure to remove any unwanted rules that are still showing up.
-
Physical File Check: Double-check that there is no physical robots.txt file left in your public_html folder. Sometimes, files can be hidden or not deleted properly.
If you continue to experience issues after these steps, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further. Thank you for raising this concern, and we’re here to help!
Hello,
There was a robots.txt file in the root directory of your site.
We have removed it and now Rank Math generates the robots.txt on your site.
We hope this helps. Please let us know if you have further questions or concerns.
Thank you.
Thank you, I don’t know what I did incorrectly as I did try deleting the robots file, but it didn’t seem to make a difference, I know at first I just renamed it and that made no difference. I’m glad it was something simple to fix and very useful to know about this as I have run into the problem before on a customers website, but they left before it was resolved.
Hello,
We are super happy that this resolved your issue. If you have any other questions in the future, know that we are here to help you.
If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.
