No: 'noindex' detected in 'X-Robots-Tag' http header?

#16294
  • Resolved Matthew Schmid
    Rank Math free

    I am having an issue with my site after installing your plugin getting an error with Google Webmaster tools saying it “couldn’t fetch the site” dud to No: ‘noindex’ detected in ‘X-Robots-Tag’ http header. I can not find this in the code and am quite confused.

Viewing 14 replies - 1 through 14 (of 14 total)
  • Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    The links on your sitemap do not possess the noindex tag, could you please check whether you have a static robots.txt file on the root of your site and rename it?

    Let us know how this goes.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Thank you so much for getting back. I have looked through my server everywhere and cannot find a robots.txt sile anywhere. On this site or by others. This is the ONLY site I am having issues with. I did find this file class-robots-txt.php . I think that may be part of this plugin right?

    Hello,

    We might need to take a closer look at the settings. Please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    I have updated that. Please let me know if I can do anything else to help. I usually can figure stuff out, but this has me stummped

    Hello,

    Thanks for the access.

    Your site configuration settings are correct, the only noindex tag is present on your sitemap file as shown below:
    Sitemap header

    I have also gone ahead to check if your pages are indexable as shown below:
    Index status

    I can suggest that you delete the current sitemap and resubmit a new one and check if the problem will still be reported.

    Thank you.

    Forgive me if I am not sure how to do that, but what is the best way to delete it.

    Thank you for all your help.

    Hello,

    Please login to your search console dashboard, click on sitemaps from the left sidebar and once you have selected the sitemap you should find an option to remove it as shown below:
    Remove sitemap

    I hope this info helps. Thank you.

    Ahh, I knew how to do that.

    I am still getting the “couldn’t fetch” error and when I inspect it then it says,

    URL is not on Google
    This page is not in the index, but not because of an error. See the details below to learn why it wasn’t indexed.

    If I ask it to index it I get:

    Indexing request rejected
    During live testing, indexing issues were detected with the URL

    Then when I check why it says:

    Indexing
    Indexing allowed?

    No: ‘noindex’ detected in ‘X-Robots-Tag’ http header
    User-declared canonical
    N/A
    Google-selected canonical

    Only determined after indexing

    I appreciate you help. I just can’t figure this out and it is driving me crazy!

    Todd
    Rank Math free

    Hi,

    Please note that a noindex tag on a sitemap file is completely normal. This is present on sitemaps generated by all SEO plugins.

    The reason we add a noindex to your sitemap file is that you do not want your sitemap file to appear in the search index.

    About the couldn’t fetch error, it is a recurrent issue with GSC. No one has any idea why it comes and why it goes away on its own. Please give it a few days. The error should vanish. Let us know if it doesn’t.

    Thank you so much. I just read that somewhere else and to get the confirmation is great.

    Thank you so much!

    Hello,

    I am glad that this information was helpful 🙂

    Feel free to contact us for any other questions, comments or suggestions.

Viewing 14 replies - 1 through 14 (of 14 total)

The ticket ‘No: 'noindex' detected in 'X-Robots-Tag' http header?’ is closed to new replies.