Robots.txt Error Issues

#52493
  • on my search console, I am seeing several error issues showing “Indexed, though blocked by robots.txt” which started since I migrated to the Rank Math plugin. Pls can you help me solve this
    this is one of the links
    and there are about 27 other and it keeps increasing as I add new content

Viewing 9 replies - 1 through 9 (of 9 total)
  • Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Alberto
    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    I have checked your website and your robots.txt file is blocking a lot of bots and paths. Are you using the default by Rank Math? You can check it by seeing if in your website root folder you have a robots.txt file. If you have one, you should delete it since Rank Math uses a virtual one.

    If you are using the Rank Math’s robots.txt, you can follow this screencast to edit the file: https://i.rankmath.com/SLF5RQ

    And then replace its content with this one (remember to replace the domain name with yours):

    User-Agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    
    Sitemap: https://yourwebsite.com/sitemap_index.xml

    Looking forward to help you.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    I have followed the guide and updated the robots.txt of my site, I am hopeful it fixes the issue. Thanks for the help

    Todd
    Rank Math free

    Hi,

    Yes, it should. You can also test the effectiveness on this website:
    https://support.google.com/webmasters/answer/6062598?hl=en

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    I have checked my site with link given above but it doesn’t show the updated robots.txt file yet, I even edit and submitted it again but still shows the previous robots.txt

    Todd
    Rank Math free

    Hi,

    It must be the cache because it is working fine for me:
    null

    Please try a hard refresh:
    Windows: Ctrl + F5
    Mac/Apple: Apple + R or command + R
    Linux: F5

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Yes. Thanks a million.i think the issue should be resolved but if the need arises will still contact your team.

    I really do appreciate the support from your team. Thanks again.

    Hello,

    We are super happy that this resolved your issue. If you have any other questions in the future, know that we are here to help you.

    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.

    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 9 replies - 1 through 9 (of 9 total)

The ticket ‘Robots.txt Error Issues’ is closed to new replies.