robots.txt

#422627
Viewing 10 replies - 1 through 10 (of 10 total)
  • Prabhat
    Rank Math agency

    Hello,

    Thank you for contacting the support.

    Please clear your website and server’s cache and see if that helps.

    If not, please login into your website via FTP/cPanel and see if there’s a physical robots.txt file in your website’s root directory.

    If yes, please delete/rename that file and clear the caches again and check the robots.txt file.

    For more details, please have a look at this guide: https://rankmath.com/kb/cant-edit-robots-txt/

    Let us know how that goes.

    Hello,

    It seems that you already marked this ticket as “Resolved”. Do you still need our assistance regarding this issue?

    If yes, please clear the cache from CDN if you are using it, and also clear your website cache, and check robots.txt again.

    Let us know how it goes.

    Thank you.

    Yes, I have cleared the cache several times.
    I don’t use CDN.
    Checked in Bing – nothing has changed.

    https://ibb.co/yW9LXRn

    Prabhat
    Rank Math agency

    Hello,

    You should not add the Allow: / property if you wish to disallow anything (like the wp-admin section) as that rule is used to allow the crawling of the entire website. Here are the default robots.txt rules of Rank Math: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules

    Coming to the issue, could you confirm if you’ve also followed the other steps mentioned in the guide I shared previously? If not, please follow it and see if that helps.

    In case the issue persists, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Now I have a hosting support service on the site. When she completes the work, I will write to you, maybe everything will work anyway)

    Prabhat
    Rank Math agency

    Hello,

    Sure, and in the meantime, if there’s anything else that we can assist you with, please let us know.

    Thank you.

    The hosting specialists said that it was your plugin that was not compatible with their settings. Therefore, to my regret, I had to remove your plugin.
    Thanks for the help!

    Prabhat
    Rank Math agency

    Hello,

    Could you allow us to have a closer look at your website to investigate the issue?

    If yes, please share the logins as requested in one of my previous replies and we will investigate further.

    Really looking forward to helping you.

    Thank you.

    Thanks for the help!
    Let me test with a new plugin for a couple of days, and then I will write to you and provide data to access my site.

    Hello,

    Let us know when we can check this further.

    Looking forward to hearing back from you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘robots.txt’ is closed to new replies.