Robots.txt submission issue

#434698
  • Resolved Ab Hub
    Rank Math free

    I have been facing issues with the robots.txt file for the last few days. submitted robots.txt file taking too much time to reflect in the live pages. For your reference, I will attach my robots.txt file below.

Viewing 7 replies - 1 through 7 (of 7 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    I’ve checked your robots.txt, but it seems that you’re using custom rules where it blocks all bots including Google.

    In this case, please update it to our recommended rules in this link:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules

    I hope that helps.

    Thank you.

    Ab Hub
    Rank Math free

    Hi Reinelle

    I have checked my robots.txt rules in Google’s robots.txt checker. The rules are fine but my problem is after submitting or updating my robots.txt file in Rankmath’s robots.txt editor in the dashboard it’s taking more than a day to update on the live page of the website.

    Kindly help me to update it.

    Thanks!

    Hello,

    After editing the robots.txt file, please try clearing your website cache and see if this updates the robots.txt file right away.

    Looking forward to helping you on this one.

    Ab Hub
    Rank Math free

    Hi Jeremy,

    I have cleared the website cache, chrome cache and even windows cache also. But it’s taking almost 1 day to get updated on the live site. Now it has been updated, no issues now. But when we tend to make any changes in an instant we felt hard.

    Hope that you will fix this in the next update.

    Thanks!

    Hello,

    If the changes are taking time to reflect on your live site, it means that it is getting heavily cached. Please check with your host if there is server-side caching that is caching your site.

    Let us know how that goes. Looking forward to helping you.

    Ab Hub
    Rank Math free

    Sorry for the late. I have raised a query with the hosting provider and found the issue is with the Cloudflare cache. And it was resolved successfully. Thank you for the great answers.

    Hello,

    Thank you for the update.

    We are super happy that this issue is already resolved. If you have any other questions in the future, know that we are here to help you.

    If you don’t mind us asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.

    If you have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 7 replies - 1 through 7 (of 7 total)

The ticket ‘Robots.txt submission issue’ is closed to new replies.