Hello,
Thank you for contacting Rank Math support, and sorry for any inconvenience that might have been caused due to that.
I can see that your robots.txt file is still being cached. Please clear your website cache and reload your robots.txt page, which should reveal the new robots.txt configuration.
Then, you can let Search Engine crawl it again.
Let us know how that goes. Looking forward to helping you with this.
Hello, Thanks for your support.
I am using the Wprocket plugin and lightspeed plugin and I removed the cache several times with them but the problem was not solved.
I even manually deleted the cache file from my host.
Please tell me how to do this?
Please help me.
Hello,
There must be server-side caching that is caching your robots.txt file. Please get in touch with your host and ask them to purge the cache for your site.
The issue should be resolved after that.
Let us know how that goes. Looking forward to your update.
Thanks, dear supporter,
I deleted the Cloudflare cache and update my robots.txt.
Hello,
Thank you for the update.
We are super happy that this issue is already resolved. If you have any other questions in the future, know that we are here to help you.
If you don’t mind us asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
If you have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.
