X-Robots-Tag: Noindex Issue on Sitemap URL

#974775
  • Resolved Revathi Priya
    Rank Math free

    Hi Rank Math Team,

    I’ve noticed that enabling the sitemap feature in Rank Math automatically adds the following header to my sitemap:

    X-Robots-Tag: noindex

    Issue Details:
    Affected URL: https://wizr.ai/sitemap_index.xml/
    Rank Math automatically adds X-Robots-Tag: noindex only to the sitemap URL.
    If I disable the sitemap feature, the header disappears.
    No custom rules in robots.txt or meta settings are forcing “noindex.”
    Hosting Provider: GoDaddy
    Rank Math Version: 1.0.238
    Can you help me resolve this so my sitemap can be indexed correctly?

    Thanks,
    Revathi Priya
    SEO specialist at Wizr AI

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    We apologize for the issue you are facing with the X-Robots-Tag being set to noindex on your sitemap URL. This can indeed prevent search engines from indexing your sitemap, which is not ideal for SEO.

    Here are a few steps you can take to troubleshoot and potentially resolve this issue:

    1. Check for Plugin Conflicts: Sometimes, other plugins may interfere with Rank Math’s settings. You can use the Health Check plugin to identify any conflicts.

    2. Review Your Theme’s Functions: Ensure that there are no custom functions in your theme that might be adding the noindex directive to your sitemap. You can check your theme’s functions.php file for any related code.

    3. Server Configuration: Since you are using GoDaddy, it might be worth checking if there are any server-level configurations or caching mechanisms that could be affecting the headers sent with your sitemap.

    4. Disable Caching for Sitemap: If you have any caching plugins active, ensure that your sitemap is excluded from caching. You can refer to our guide on excluding sitemaps from caching.

    5. Contact Hosting Support: If the issue persists, it may be beneficial to reach out to GoDaddy support to see if they can provide insights into why the noindex header is being added.

    If none of these steps resolve the issue, please reply to this ticket with any additional details or findings, and a human agent from our support team will take over and assist you further.

    Thank you for bringing this concern to our attention!

    Sources:
    Robots Meta Tag vs X-Robots: Understanding the Difference » Rank Math

    Revathi Priya
    Rank Math free

    Urgent: X-Robots-Tag Noindex Issue on Sitemap – Rank Math

    Dear Rank Math Support Team,

    I’ve been experiencing an issue where enabling the sitemap feature in Rank Math automatically adds the following header to my sitemap:

    X-Robots-Tag: noindex

    Issue Details:
    Affected URL: https://wizr.ai/sitemap_index.xml/
    Issue: Rank Math is adding X-Robots-Tag: noindex only to the sitemap URL.
    Findings:
    If I disable the sitemap feature, the header disappears.
    There are no custom rules in robots.txt or meta settings that enforce “noindex.”
    Hosting Provider: GoDaddy
    Rank Math Version: 1.0.238
    Troubleshooting Steps Taken:
    I have already tried the following but the issue persists:
    ✔ Checked for Plugin Conflicts – Deactivated all plugins except Rank Math, but the issue remains.
    ✔ Reviewed Theme Functions – No custom functions adding noindex to the sitemap.
    ✔ Checked Server Configuration – No server rules forcing the noindex header.
    ✔ Disabled Sitemap Caching – Excluded the sitemap from caching, but it didn’t help.
    ✔ Contacted GoDaddy Support – No server-side restrictions affecting the sitemap.

    Since this issue only occurs when Rank Math’s sitemap is enabled, I believe this might be a bug or an unintended behavior in the plugin.

    Could you please check and provide a fix for this ASAP? This is critical for our SEO.

    Looking forward to your response.

    Best Regards,
    Revathi Priya
    SEO Specialist, Wizr AI

    Hello,

    Thank you so much for getting in touch.

    Sitemaps are designed to be crawled by search engines, not indexed. The X-Robots-Tag: noindex directive ensures that the sitemap itself does not appear in search results, but this does not prevent Google from crawling its contents and indexing the pages listed within it.

    There’s no need to worry as this is the expected behavior for sitemaps.

    Let us know if you have any other questions.

    Revathi Priya
    Rank Math free

    Hi Jeremy,

    Thank you for your response. I understand that sitemaps are meant for crawling and not indexing. However, I would like to clarify why RankMath adds a noindex directive to the sitemap.

    Since Google does not require sitemaps to be noindex, and it is not mentioned as a best practice in Google’s guidelines, could you confirm:

    What is the reason for adding the noindex tag to the sitemap?
    Will this impact how Google discovers and processes the sitemap?
    Is there an option to remove this directive if needed?

    Looking forward to your response.

    Best regards,
    Revathi Priya
    SEO Specialist, Wizr AI

    Hello,

    Please note that a sitemap is just a blueprint of your website that helps search engines find, crawl and index your website’s content. The XML sitemap itself doesn’t have any SEO value, which you want to index on SERPs and show your users, and that’s why Rank Math adds the Noindex to your sitemap.

    But, even though it is set to Noindex, Google can crawl and fetch the URLs from your sitemap, which is necessary. You can also check this thread from Google product experts:
    https://support.google.com/webmasters/thread/219882691/my-sitemap-file-is-marked-with-noindex-tag?hl=en

    However, if you still want to set your sitemap to index and want to show this on SERPs, you can use the following filter on your website:

    add_filter( 'rank_math/sitemap/http_headers', function( $headers ) {
    	if ( '/sitemap_index.xml' !== $_SERVER['REQUEST_URI'] ) {
    		return $headers;
    	}
    	unset( $headers['X-Robots-Tag'] );
    	return $headers;
    } );
    

    Here’s how you can add filter/hook to your WordPress site: https://rankmath.com/kb/wordpress-hooks-actions-filters/

    After applying the filter, please clear your sitemap cache by following this screencast: https://i.rankmath.com/pipRDp

    Hope that helps and please don’t hesitate to let us know if you have any other questions.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘X-Robots-Tag: Noindex Issue on Sitemap URL’ is closed to new replies.