Hello,
Thank you for contacting Rank Math, and sorry for any inconvenience caused.
Semrush is reporting that error on your website as the robots.txt file does not contain the sitemap. Check the screenshot in the sensitive data section.
If you are managing the robots.txt file with Rank Math, please edit the robots.txt file at Rank Math > General settings > Edit robots.txt
Make sure your robots.txt file looks similar to the below-mentioned one:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://yourdomain.com/sitemap_index.xml
Replace yourdomain.com with your own domain name.
If you are not able to edit the robots.txt file with Rank Math.
Log in to your web server via FTP and delete the robots.txt file present in the root folder.
It is the same folder where you have your wp-content, wp-admin
etc.. folders.
Once you delete the robots.txt file, Rank Math’s virtual robots.txt file will take over and you will be able to edit the robots.txt file without issues.
I hope this helps. Looking forward to helping you.
Hey,
Sorry for the late reply. I have made the changes using Rankmath – gen settings – edit robots. Could you please check again and see if the error still exists?
Hello,
The robots.txt file on your website now mentions your sitemap and its URL. Please see the screenshot in the sensitive data section of this ticket.
Please clear your website’s cache and test the website again with Semrush and see if the error is gone.
Let us know how that goes.
Thank you.
Hello,
Glad that helped.
Please feel free to reach out to us again in case you need any other assistance.
We are here to help.
Thank you.
