Blocked by robots.txt Despite of Right robots.txt file!!

#595365
  • Resolved USM LoveLy
    Rank Math free

    Hey there,

    A few days back I set a staging environment for my website to make some changes. After doing that, I published my stagging site and replaced it with the original one. I was happy with the results; so, deleted my stagging site from hosting.

    Now, when I request Google to re-index (re-visit) my page, it is showing a “Blocked by robots.txt” error. I checked the robots.txt file, and yes, it was blocking all the bots.

    I created a new robots.txt file using Rank Math. But, the error is still there. It is happening for the last 24 hours.

    Can you assist what is the actual problem?

    In settings > reading > Search engine visibility is also unchecked.

    Looking Forward
    Usman

Viewing 1 replies (of 1 total)
  • Hello,

    Thanks for contacting us, and sorry for any inconvenience that might have been caused due to that.

    Please try clearing your site, plugin, or any server-level cache and try again to see if that works for you.

    If the issue persists, then we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    Looking forward to helping you.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘Blocked by robots.txt Despite of Right robots.txt file!!’ is closed to new replies.