Hello,
I apologize for the inconvenience you are facing with the robots.txt feature. It seems that the contents of the /robots.txt file as seen via the browser do not match what is set in the WP Rank Math General Settings under Edit robots.txt.
If there is no physical file found in the root or WP directories, and Rank Math recognizes the WP setting to not include in search engines, it might be due to a virtual robots.txt file created by Rank Math.
To ensure that the correct directives are being applied, you can try the following steps:
- Check if there are any conflicting plugins creating a robots.txt file.
- Verify the permissions on the web server to ensure Rank Math can modify the virtual robots.txt file.
If the issue persists, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.
Thank you for bringing this to our attention.
Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
I Can’t Edit My Website’s Robots.txt » Rank Math
Hello,
Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.
Please try to clear your website cache including any server-level cache and check again.
If the issue persists, please share your website URL in the sensitive data section so that we can check the issue further for you.
Let us know how it goes. Looking forward to helping you.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
