How to remove X-Robots-Tag HTTP header noindex tag.

#635273
  • Resolved Sb

    1 year, 3 months ago

    Rank Math free

    hello.
    My WordPress site is currently not being indexed by Google Search Console due to the X-Robots-Tag HTTP header ‘noindex’ tag.
    I have made it visible to search engines in the tool of WordPress settings and also unchecked noindex in ‘sitemap settings’ and ‘title and meta’ in the rank mess plugin.

    But Still, it’s not indexed in Google Search Console.

    Importantly, if I deactivate the Rank mess plugin, it’s fixed.
    I’m not sure why this is the case.

    Thanks.

Viewing 9 replies - 1 through 9 (of 9 total)
  • Rakibuzzaman Siam

    1 year, 3 months ago

    Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    Can you please share your website URL with us so that we can check the issue further for you?

    Meanwhile, please try to follow the steps from this guideline and see if that helps you to resolve the issue: https://rankmath.com/kb/excluded-by-noindex-tag/

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Sb

    1 year, 3 months ago

    Rank Math free

    Hello,

    I’ve already tried following the link you sent above, but it doesn’t work.

    My website is

    thegoodsreview.com

    thank you!

    Jaideep Asrani

    1 year, 3 months ago

    Hello,

    I checked your site and the X-Robots-Tag is not preventing your site’s indexing. Is there a specific URL that is returning this error?

    If the issue is for the sitemap, then it is completely fine as the sitemaps are not supposed to be indexed. You shouldn’t submit sitemaps for indexing. You should only submit them to the Sitemap section of your GSC account.

    Looking forward to helping you.

    Sb

    1 year, 3 months ago

    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Jaideep Asrani

    1 year, 3 months ago

    Hello,

    You are checking it for the wp-json path and that is supposed to be set to Noindex as these URLs are only for internal use, not to be indexed. This isn’t going to cause any issues with the indexing of the page.

    If you are facing issues with the indexing of your site, then check the Page Indexing Report of your GSC account or use the URL inspection tool to check the actual URLs of your site and see if there are any issues.

    Looking forward to helping you.

    Sb

    1 year, 3 months ago

    Rank Math free

    hello.
    Thank you for your kind reply!

    I understand what you said.
    Could you please confirm one more thing?

    If you look at the screenshot

    https://imgur.com/a/4t00Aqk

    1. the sitemap submission is successful as shown in the screenshot.
    2. but the URL test of ‘sitemap_index.xml’, ‘sitemap.xml’ is a failure.
    3. the indexing screen is not appearing.

    Is this okay??

    Thanks!

    Reinelle

    1 year, 3 months ago

    Hello,

    Thank you for your patience.

    Yes, that is normal as you should not inspect the sitemap URLs (/sitemap_index.xml and /sitemap.xml) as those are only used for crawling.

    Please note that by default, sitemaps are set to noindex as they are meant to be crawled and not to be displayed on search results pages.

    Hope that clears up the confusion.

    Sb

    1 year, 3 months ago

    Rank Math free

    Thank you for your help~!

    Reinelle

    1 year, 3 months ago

    Hello,
    
    You’re welcome.

    We are super happy that this issue is already resolved. If you have any other questions in the future, know that we are here to help you.
    
    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
    
    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
    
    Thank you.

Viewing 9 replies - 1 through 9 (of 9 total)

The ticket ‘How to remove X-Robots-Tag HTTP header noindex tag.’ is closed to new replies.