Sitemaps crawled but all urls excluded by noindex tag

#41697
  • Resolved Thethemebuilders
    Rank Math free

    Hello RankMath Team:

    We are giving your plugin a whirl on a client site. All of the sitemaps are showing as indexed

    Sitemaps Indexed successfully

    But when we click on coverage in the Search Console we see that actual links are excluded from Coverage:

    Coverage Result after Indexing

    and when we inspect any specific URL we see the they are reported as being excluded by a NoIndex Tag:

    NoIndex Tag excluding page from indexing

    Inspecting the page source we can see that robots are set to follow:

    <meta name="robots" content="follow, index, max-snippet:-1, max-video-preview:-1, max-image-preview:large"/>

    Perhaps we are having a brainfart or we are missing a setting in the plugin for which we are as of yet certainly lacking deep familiarity. We did review the settings and as far as we can tell we are not deliberately telling search engines not to index pages.

    We checked the Search Engines Visibility setting in Settings/Reading and the box is not checkmarked. So we are not excluding via that setting.

    We did review your support topics. We see some open threads on this topic but most were abandoned and a public resolution is not posted insofar as we can observe.

    Thank you for your time and attention to this matter.

Viewing 6 replies - 1 through 6 (of 6 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    I think that you have followed all the right steps and this should work. I have also checked your robots.txt file and everything seems to be configured correctly.

    Is it possible that you have an aggressive caching mechanism on your server that could be affecting how your pages appear to bots? Could you please purge your cache and then test one of the affected URLs on the URL inspection tool?

    Looking forward to helping you. Thank you.

    ​​​​​​​

    HI Michael:

    Thank you for your prompt reply. We are a litespeed host but the litespeed plugin is not on this website at this particular time. As an additional step we activated litespeed, cleared all the caches again to confirm nothing was cached (as it would clear the server side caches as well with this action) and then deactivated it.

    BTW, is Rank Math compatible with Litespeed?

    We retested after running through the cache clearing and it is still showing Coverage as “Excluded by “noindex” tag. We tested the homepage.

    We can provide access to the site if you feel this would be beneficial.

    Thank You
    The ThemeBuilders

    I didn’t get the answer of this issue URL marked ‘noindex’ please explaine

    I didn’t get the answer of this issue URL marked ‘noindex’ please explain

    I didn’t get the answer of noindex issue, please explain

    Hello,

    Thanks for the reply.

    Yes the plugin is compatible with Lightspeed and we would be happy to check this further.
    Please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/


    @bimleshsharma
    could you please open a new ticket and share more info on the kind of issue that you are experiencing so that we can be in a better position to help?

    We really look forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 6 replies - 1 through 6 (of 6 total)

The ticket ‘Sitemaps crawled but all urls excluded by noindex tag’ is closed to new replies.