Problema con x-robots-tag: noindex en sitemap después de actualización

#1099276
  • Resolved Empresa Cistel
    Rank Math free

    Hola equipo de soporte de RankMath,

    Mi nombre es Ricardo Coria y administro el sitio lavadodecisternashoymismo.com.

    Desde aproximadamente el 30 de agosto de 2025, noté que la homepage de mi sitio dejó de aparecer indexada en Google, aunque otras páginas y entradas del blog siguen apareciendo correctamente. Al revisar Google Search Console apareció el error No se ha podido leer el sitemap y también avisos de No se ha analizado ningún mapa del sitio válido para el rastreador en el administrado de WordPress, y en PageSpeed se mostraban problemas al descargar el robots.txt.

    Tras investigar y comunicarme con el soporte de mi hosting (DreamHost), confirmaron que el problema no está relacionado con un mantenimiento del servidor o con errores en el archivo de robots.txt. Según su diagnóstico, el origen real es que RankMath está agregando un encabezado HTTP x-robots-tag: noindex al sitemap, lo que impide que Google lo lea correctamente.

    Me recomendaron que verificara la configuración de RankMath en las opciones de Títulos y Meta o Sitemap, pero en el panel las configuraciones que tengo establecidas son correctas y no deberían de agregar x-robots-tag: noindex en el sitemap.

    Adjunto resultados relevantes de las comprobaciones curl:

    Con sitemap activo en RankMath:
    PS C:\> curl.exe -Ik “https://www.lavadodecisternashoymismo.com/sitemap_index.xml”
    HTTP/1.1 200 OK
    X-Robots-Tag: noindex

    Hoy, para intentar normalizar la indexación, realicé las siguientes acciones:

    Se comprobó, como ya me había indicado el soporte de Dreamhost, que RankMath agrega el x-robots-tag: noindex en el sitemap, pues al desactivar temporalmente el plugin, esta etiqueta ya no aparece.
    Desactivé temporalmente el sitemap de RankMath.
    Creé un sitemap temporal con el plugin Google XML Sitemaps y verifiqué que se muestra correctamente sin noindex.
    Limpié la cache de LiteSpeed Cache y los datos transitorios de RankMath.
    Solicité la indexación de la homepage en Search Console.

    A pesar de estas acciones, me gustaría asegurarme de que RankMath pueda generar un sitemap limpio y sin x-robots-tag: noindex, y entender si esta configuración se debe a un ajuste de la actualización reciente (versión 1.0.252/1.0.252.1, 28–29 de agosto de 2025).

    Por favor, ¿pueden indicarme:
    Cómo evito que RankMath agregue x-robots-tag: noindex al sitemap?
    Si existe algún ajuste adicional que debamos revisar en la configuración de Títulos & Meta o Sitemap?
    Si es recomendable revertir temporalmente a una versión anterior de RankMath para restablecer la indexación sin afectar otros ajustes SEO?

    Quedo atento a su orientación para resolver este problema y mantener la indexación correcta de mi homepage.

    Muchas gracias por su apoyo.

    Saludos,
    Ricardo Coria
    lavadodecisternashoymismo.com

Viewing 9 replies - 1 through 9 (of 9 total)
  • Hello,

    We apologize for the issue you are facing with the x-robots-tag: noindex in your sitemap. It seems like you’ve already done a thorough investigation and taken several steps to troubleshoot the problem.

    To address the x-robots-tag: noindex issue, please ensure that:

    1. Check Rank Math Settings: Go to Rank Math SEO → Titles & Meta Settings and verify that there are no settings that might be adding the noindex tag to your sitemap.
    2. Sitemap Settings: Ensure that your sitemap settings in Rank Math SEO → Sitemap Settings are configured correctly and that you haven’t inadvertently set any rules that would apply a noindex directive.
    3. Plugin Conflicts: Sometimes, other plugins can conflict with Rank Math. You can use the Health Check plugin to check for any conflicts without affecting your live site.
    4. Custom Code: If you have added any custom code to your theme or functions.php file, please review it to ensure it’s not affecting the sitemap output.

    If after checking these settings the issue persists, we recommend replying to this ticket with your site URL so that a human agent from our support team can assist you further. They will be able to take a closer look at your specific configuration and help resolve the issue.

    Thank you for bringing this concern to our attention, and we appreciate your patience as we work to resolve it!

    Sources:
    How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math

    Thank you for the initial response. I have already carefully reviewed the following:

    Rank Math Settings → Titles & Meta: the homepage, posts, pages, categories, and tags are all set to index.
    Sitemap Settings: all relevant sitemaps are correctly enabled; no custom noindex rules are applied.
    Plugin Conflicts: the issue persists even with other plugins temporarily disabled.
    Custom Code: no custom code affecting the sitemap output.

    The x-robots-tag: noindex appears in the headers of sitemap_index.xml only when Rank Math’s sitemap is active. Disabling Rank Math removes the header.
    I have also generated a temporary working sitemap using the Google XML Sitemap plugin to ensure site indexing continues while this is being investigated.

    Site URL: https://www.lavadodecisternashoymismo.com

    Could a human agent please review my site configuration and assist in resolving this issue?
    Thank you for your help and attention.

    Hello,

    Please note that RankMath sets the “noindex” tag on your sitemaps by default. It’s done this way because a sitemap is only meant to guide search engines through your site, not to rank in search results.

    The reason you’re seeing it set to “noindex” is to prevent it from appearing in search results, which is the desired behavior.

    However, if you still wish to remove the noindex tag from your sitemap, you can use the filter on your site:

    add_filter( 'rank_math/sitemap/http_headers', function( $headers ) {
    	if ( '/sitemap_index.xml' !== $_SERVER['REQUEST_URI'] ) {
    		return $headers;
    	}
    	unset( $headers['X-Robots-Tag'] );
    	return $headers;
    } );

    Here’s how you can add a filter/hook to your WordPress site:
    https://rankmath.com/kb/wordpress-hooks-actions-filters/

    Looking forward to helping you.

    I have been using Rank Math on my website https://www.lavadodecisternashoymismo.com/ since December 2024 without any issues regarding the sitemap or the default noindex tag. Everything was working correctly, and Google was able to access the sitemap without any problems.

    On August 28, 2025, Rank Math released an update, and on the same day my hosting provider performed a BIOS update and a controlled reboot of the shared server.

    Since then, Google has been unable to access the sitemap, and the homepage of my site is no longer indexed.

    I would like to ask if it’s possible that the combination of the Rank Math update and the server update caused Google to fail in accessing the sitemap correctly, or if there could be another interaction I should consider.
    I would appreciate any guidance on how to handle this situation while waiting for a permanent fix from the plugin update.

    Thank you for your time and support.

    Hello,

    We’ve checked your robots.txt, and they are already using the default and recommended rules for indexing. Also, your homepage is already indexed using the site: operator

    home

    However, your sitemap is getting a 404 error.

    In this case, please follow these steps to flush your sitemap cache:

    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/pipRDp

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    3. Disable the transient cache for the sitemap by applying this filter. This will make sure that your XML sitemap always reflects the latest changes on your site:

    /** 
     * Filter if XML sitemap transient cache is enabled.
     *
     * @param boolean $unsigned Enable cache or not, defaults to true
     */
    add_filter( 'rank_math/sitemap/enable_caching', '__return_false');

    If you’re not sure how to add this code, you can follow this guide:
    https://rankmath.com/kb/wordpress-hooks-actions-filters/

    Also, head over to your website files /uploads/rankmath/, and delete any XML files from that path.

    Looking forward to helping you.

    Empresa Cistel
    Rank Math free

    Hello Reinelle,

    Fortunately, my homepage has already reappeared in the search results, and in Search Console it is now marked as indexed.

    The reason you might still see a 404 error for the sitemap is because I am currently using a temporary one. Here it is:
    https://www.lavadodecisternashoymismo.com/sitemap.xml

    Since I submitted this temporary sitemap to Search Console on September 8th, my homepage has been showing again in the search results starting September 9th.

    For now, I have the Rank Math sitemap desactivated, but I am keeping all the other features of the plugin active. I plan to continue using the temporary sitemap, as I do not want to risk reactivating the Rank Math sitemap and having Search Console fail to detect it again, which could cause my homepage to disappear from the results once more.

    I would also like to note that I already applied your recommendations regarding clearing the cache and excluding the sitemap from my caching plugin.

    Thank you for your support.

    Hello,

    We completely understand that.

    Since you’re using a different sitemap URL, we suggest updating the sitemap link in your robots.txt as well.

    Here’s a guide you can follow to update it using Rank Math:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#edit-robotstxt

    If you have any other concerns, please don’t hesitate to contact us anytime so we can assist you further.

    Looking forward to helping you.

    Hello,

    Thank you very much for your support. I will proceed to update my robots.txt to point to the temporary sitemap as suggested.

    For now, this resolves my concern, so we can close this ticket.

    I really appreciate your assistance.

    Best regards.

    Hello,

    We are glad that helped.

    Please feel free to reach out to us again in case you need any other assistance.

    We are here to help.

    Thank you.

Viewing 9 replies - 1 through 9 (of 9 total)

The ticket ‘Problema con x-robots-tag: noindex en sitemap después de actualización’ is closed to new replies.