page is not getting indexed –

#1025173
  • Resolved Berlin Kultour
    Rank Math free

    Dear Rank Math Team,

    my Homepage is not getting indexed when I use the Rank math plugin – it works when I deactivate rank math. How can I solve the problem? Here is a list of things I already tried:

    1 The https://berlinkultour.de/main-sitemap.xsl file has an X-Robots-Tag: noindex in its HTTP header, preventing search engines from indexing it.
    2 Initially, we found the X-Robots-Tag: noindex on the sitemap_index.xml file.
    3 We thoroughly reviewed all relevant settings in Yoast SEO related to search appearance and sitemaps.
    4 We inspected the advanced settings in the Yoast SEO meta box for individual content items.
    5 We checked these theme files (functions.php and seo.php of Salient) for any direct manipulation of robots tags or sitemaps.
    6 We examined the .htaccess file for any rules related to X-Robots-Tag or sitemap handling.
    7 The problem persisted with only Yoast SEO active after deactivating all other plugins.
    8 We cleared WordPress and browser caches multiple times.
    9 The X-Robots-Tag: noindex disappeared from the sitemap_index.xml file after deactivating Yoast SEO.
    10 We installed Rank Math and deactivated/deleted Yoast SEO.
    11 We configured the sitemap settings in Rank Math.
    12 The problem shifted to the stylesheet file (main-sitemap.xsl) after switching to Rank Math.
    13 The global and post-type/taxonomy robots meta settings in Rank Math were set to “Index”.
    14 We thoroughly reviewed all tabs and options in the Rank Math sitemap settings.
    15 The X-Robots-Tag: noindex remained on the main-sitemap.xsl file with only Rank Math active after deactivating all other plugins.
    16 We switched to a default theme (like Twenty Twenty-One) with only Rank Math active, and the issue persisted.
    17 We looked for a “cache” folder in wp-content but didn’t find one.
    18 We noted the presence of a static robots.txt file.
    19 We confirmed there are no rules in .htaccess adding the X-Robots-Tag.
    20 We reviewed the active Rank Math modules, none of which seemed directly related to this issue.
    21 We checked global, post-type, and taxonomy title and meta settings in Rank Math for any “noindex” directives.
    22 We checked the general settings, links, webmaster tools, etc., in Rank Math for any relevant options.
    23 We reviewed the information provided in Rank Math’s “Status & Werkzeuge,” which didn’t reveal any obvious causes.
    24 The installed Rank Math version is 1.0.243.
    25 We deactivated the Salient theme and activated a standard theme with only Rank Math active, and the issue still persisted.

    Can you please tell me why RankMath seems to block the indexing of my hp?
    Thank you
    Tobi

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math support and we apologise for any inconvenience caused.

    If you’re submitting a sitemap URL in URL Inspection Tool, then you shouldn’t be worried about the “No: “noindex” detected in the HTTP header “X-Robots-Tag” error, as it’s completely fine and absolutely normal to have noindex tag on your sitemap URLs. Because, by default, sitemap URLs are set to noindex as it is not meant to be indexed and appear in the search results.

    The sitemap should only be submitted in the sitemaps sections in the Search Console.

    The reason is that we don’t want Google to index the sitemap itself, we only want them to index the pages and posts that are listed on the sitemap. The sitemap is just a way to tell Google what pages and posts you have on your website, not a page that you want to show up in search results.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Hello,
    thank you for your answer.
    When I try to index the sitemap in the google search console it is also telling me that it can’t get indexed because the site is not on google.
    Do you have ideas what I could do about that?
    Thank you

    Hello,

    You shouldn’t submit your sitemap URL to Google and request it for indexing.

    Sitemaps are not meant to show on the search results pages, only the links inside them.

    Here’s a guide on how to properly submit your sitemap to your Google Search Console account:
    https://rankmath.com/kb/submit-sitemap-to-google/

    You should check your Google Search Console > Indexing > Pages section to determine any issues reported on your URLs that may have prevented your site from being indexed:
    https://support.google.com/webmasters/answer/7440203?hl=en

    You can share the screenshot of the report here so we can check it as well. You can upload screenshots using this tool and add the link here.

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘page is not getting indexed –’ is closed to new replies.