Hello,
Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.
If you do not have robots.txt file on the root of your site, you can modify the virtual robots.tx file that is found in Rank Math > General settings as shown below:
I hope this info helps. Thank you.
​​​​​​​
Hi
Thanks for your answer but no. I do not have robots.txt on root and in Rank Math > General settings i have write only User-Agent:* but in my robots.txt on line I have also a line Sitemap: …. (please note it’s a demo website and i have any others plugin Rank math is the only one. It’s Rank Math which add this line. ANy idea to solve this (perhaps with function.php 😉
Thanks for your helps
Hi there,
Thanks for the follow up.
This file is normally empty by default and WordPress will handle the contents dynamically. You can however edit and modify with some new definitions without adding the sitemap definition and this will take effect once you save the changes.
I hope this info helps. Thank you.
Thanks, but I’m afraid I don’t understand.
My aim is to use your plugin. So in Rank Math General Settings > Edit robots.txt > I have just “User-agent: *”. Even if I click on “Reset options” and rewrite again just “User-agent: *” the virtual rank math robotx.txt add a line with Sitemap:…
I want to update my robots.txt with your plugin and not have this line. How to do this. Any idea ?
Thanks again for your answer.
Hi there,
Thanks for the follow up.
I am afraid that I cannot reproduce this issue on my end. Would you mind clearing your site cache to check whether the new changes will take effect?
If the issue persists, please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section so that we can check further.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
We really look forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
I am not sure why you have an issue with Rank Math adding that default text to your robots.txt file?
Would you rather have a blank robots.txt file?
If so, you can use this filter to do that: https://rankmath.com/kb/filters-hooks-api-developer/#change-robots-meta
User-agent: *
Disallow: /
This code in the robots.txt is as good as a blank robots file. All it means is that Google and other bots are free to index every single page on your website. Having a blank robots.txt file does exactly the same.
But, I might be missing something in which case please feel free to correct me 🙂
Hi Todd,
If you look at my https://www.mydomaine.com/robots.txt (change mydomaine.com by my real domain name) file you will see theses 3 lines
User-agent: *
Disallow: /
Sitemap: https://www.mydomaine.com/sitemap_index.xml
But if you look at Rank Math > General Settings > Edits Robots.txt (/wp-admin/admin.php?page=rank-math-options-general) you will see only this :
User-agent: *
Disallow: /
Why Rank Math add Sitemap: http://www.mydomaine.com/sitemap_index.xml ? HOw I can delete this ? Is my credentials can help you to see a solution ?
Hope I’m clear. Can you help me to solve this ?
Regards
Hello,
Sorry but the logins you provided are no longer working.
Can you please send us a new login link as well as some FTP details so we can check this issue in depth?
We look forward to hearing back from you.
HI,
Try again with the credentials (we udapte it).
Thanks
Hello,
Can you also add your site’s FTP details in the Sensitive Data Section so we can check the issue in depth?
Looking forward to helping you. Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
