Hello,
Thank you for contacting Rank Math, and sorry for any inconvenience caused.
If you are using a CDN, please clear the cache from there and also clear your website cache, and check robots.txt again.
Let us know how it goes.
We are here to assist you.
Hello Anas,
Thank you so much for helping me out in solving this issue. I just cleared the CDN cache and it’s working now. And could you please tell me why I was not able to find the robots.txt in my website’s root directory?
Hello,
Our plugin generates the robots.txt file dynamically that’s why there is no physical file in your site’s roots directory.
Hope this helps. Let us know if you need any other assistance.
Thanks.
Hello Jaideep,
And what if I manually add a robots.txt file in my website’s root directory then which will work the manual one or the file dynamically created by rank math??
Hello,
If you create a manual one then the manual one will work. However, having a dynamic file is as good as having a physical file and you can easily edit the dynamic file from Rank Math’s settings.
Hope this helps. Let us know if you need any other assistance.
Thanks.
Thank you so much for helping me out.
Hello,
We are glad we could address your concerns. If you have any other questions in the future, know that we are here to help you.
If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.
