Validation failed – indexed, though blocked by robots.txt

#45610
Viewing 7 replies - 1 through 7 (of 7 total)
  • Hello,

    Thank you for contacting Rank Math today.

    This should not cause any worry since you intentionally set these pages to noindex.
    Google will periodically show this warning to the user so as to check if this was done by mistake.

    Looking forward to helping you. Thank you.

    ​​​​​​

    Hi Michael, thanks very much for getting back to me. I think the issue is that I’ve blocked them with robots.txt but they are still being indexed?

    Hi Michael,

    Thank you for the reply.

    The noindex option technically adds the affected post to the robots.txt file with a disallow directive. I’ve just checked one of the affected links and can confirm that it has not been indexed. Here is a screenshot:
    SERP result

    I don’t think that there’s any additional step required from your end.

    Thank you.

    Dennis Dunleavy
    Rank Math pro
    Content AI Starter

    Hi I am getting this message from GSC as well: Indexed, though blocked by robots.txt
    How do i fix this?

    Thank you,
    Dennis

    Todd
    Rank Math free

    Hi Dennis, You might want to check your robots.txt file.

    If you are using a physical file, make changes to it via your FTP client.

    If you are using the one generated by Rank Math, you can make changes at WordPress Dashboard > Rank Math > General Settings > Edit robots,txt

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Dennis Dunleavy
    Rank Math pro
    Content AI Starter

    I did that but what should the file contain? here is a screenshot of what Rankmath created.
    https://www.dropbox.com/s/1mhlqeqpnp2htcr/Screenshot%202020-04-27%2009.55.15.png?dl=0

    Should I change anything?

    Thanks,
    Dennis

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    It looks like there is another robots.txt file generated by Flywheel that is getting loaded on your site. The contents are as shown below:

    # Default Flywheel robots file
    User-agent: *
    Allow: /*?v
    Disallow: /calendar/action*
    Disallow: /events/action*
    Disallow: /*?
    Crawl-delay: 3

    You can also check here: https://comfortandcaremedical.com/robots.txt

    Please login to your site via FTP and delete the static robots.txt file.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 7 replies - 1 through 7 (of 7 total)

The ticket ‘Validation failed – indexed, though blocked by robots.txt’ is closed to new replies.