Can’t resolve noindex issue

#943351
  • Resolved Don Caron
    Rank Math pro
    Content AI Creator

    Google is not indexing most of the pages on glamgrader.com

    ahrefs shows these unindexed pages as having an x-robots-tag in the HTTP header set to noindex.

    However, when I do a search in WordPress Posts using the Rankmath filter it does not show any posts as having a noindex status, though a couple hundred of them do have noindex status. There is nothing I can find in the htaccess file or wp-config that would cause the noindex. Likewise with robots.txt

    All of the settings in Rankmath that govern indexing are set correctly to allow indexing.

    After spending a couple of days trying to debug this, I realize it’s above my paygrade and I’m reaching out for help.

Viewing 6 replies - 1 through 6 (of 6 total)
  • Hello,

    We apologize for the issue you are facing with the noindex status on your pages. It sounds like you’ve done a thorough job of checking various settings and configurations. Here are a few steps you can take to further troubleshoot the issue:

    1. Check Rank Math’s Titles & Meta Settings: Ensure that the noindex setting is not set as a default value in your Titles & Meta settings. You can do this by navigating to WordPress Dashboard → Rank Math SEO → Titles & Meta and checking each tab to confirm that the settings are as per your preference. If any posts or pages are set to "noindex" incorrectly, you can change them to "Index" as shown below:
      Index tags

    2. Search Engine Visibility Settings: Go to Settings → Reading in your WordPress dashboard and check the Search Engine Visibility section. Make sure the checkbox labeled Discourage search engines from indexing this site is unchecked. If it is checked, uncheck it and click Save Changes.
      Leave Search engine visibility unchecked

    3. Check for X-Robots-Tag in HTTP Headers: Since Ahrefs indicates that there is an x-robots-tag set to noindex, you may want to check if there are any server-level configurations or plugins that might be adding this header. You can use tools like cURL or browser developer tools to inspect the HTTP headers of your pages.

    4. Robots.txt File: Although you mentioned that there’s nothing in the robots.txt file, it’s worth double-checking that there are no disallow rules that might be affecting indexing. You can edit your robots.txt file through Rank Math at WordPress Dashboard → Rank Math SEO → General Settings → Edit Robots.txt.
      Edit robots.txt

    If after checking these settings the issue persists, we recommend replying to this ticket so a human agent from the Rank Math Support team can assist you further. Thank you for raising this concern, and we hope to help you resolve it soon!

    Sources:
    How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math
    Fix Excluded by NoIndex Tag – Google Search Console Status » Rank Math

    Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    We checked your homepage but were not able to find any issue there:

    If you’re facing the issue with some other pages, please share the affected URL with us so that we can check this further for you.

    Looking forward to helping you.

    Don Caron
    Rank Math pro
    Content AI Creator

    There are over 100 post pages on glamgrader.com that are showing in Google Console and in ahrefs as containing a noindex tag. All the settings in Rankmath are as required for indexing. I don’t know where the noindex is originating as explained in my ticket

    Here are a couple of examples
    https://glamgrader.com/brand-best-lipstick/
    https://glamgrader.com/best-foundations-dry-skin/
    https://glamgrader.com/get-pink-lips/
    https://glamgrader.com/lip-gloss-good-or-bad/
    https://glamgrader.com/pop-a-pimple/
    https://glamgrader.com/what-lipstick-stays-on-longest/
    https://glamgrader.com/best-lipstick-shade-for-your-skin-tone/

    Here is the excerpt from ahrefs that shows for the non-indexed pages

    https://glamgrader.com/lipstick-everything-you-ever-wanted-to-know/

    X-robots-tag (HTTP header) noindexΩ

    HTTP headers
    Server
    nginx
    X-robots-tag noindex

    Hello,

    The links you shared are showing 404 not found, as well as your other pages on your homepage.

    Please check this issue first so we can view those pages and investigate further.

    Looking forward to helping you.

    Don Caron
    Rank Math pro
    Content AI Creator

    Thanks Reinelle, the 404 error issues is fixed now so you can proceed with my support ticket

    Hello,

    We checked those pages’ source code and can see that their meta robots are set to index.

    Please share a screenshot of the report from Google Search Console reporting noindex on those pages.

    You can use the following tool to share screenshots with us: https://imgur.com/upload

    We look forward to helping you.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 6 replies - 1 through 6 (of 6 total)

The ticket ‘Can’t resolve noindex issue’ is closed to new replies.