URL is not on Google indexing error

#33790
  • Hello,

    I have submitted the site map on Google Console, 4 pages out of five have been indexed successfully, however, one page, URL that I have provided in the sensitive data was not indexed with the below error showing up when I inspect the URL on Google search console.
    the error is Page fetch

    Failed: Crawl anomaly

    I have also provided a few examples of posts URLs that were not indexed with the error,
    Indexing allowed?

    No: ‘noindex’ detected in ‘robots’ meta tag

    Please advise which settings in rank math I need to tweak to remove these tags being generated?

    Thanks
    Jay

Viewing 10 replies - 1 through 10 (of 10 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    All these posts have been set to index. Could you please clear your cache and test again?

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Hi Michael,

    Thanks for looking into this, yes you are right all the posts have been indexed, however, one page in the sensitive date foodie-map was unable to index with the below error.

    Page fetch

    Failed: Not found (404)

    If you could please advise a way to resolve this that would be great.

    Thanks
    Jay

    Todd
    Rank Math free

    Hi Jay,

    If you load that page in your browser, you will see that it opens fine:
    /foodie-map/

    It is possible that there was a 404 when Google last tested it but it is showing a 200 status code now which means OK. Give it a few days before it is indexed like the rest of your posts/pages.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Hi Todd,

    Thanks a lot for the response I really appreciate it, as you suggest I will give it a few days and check again hopefully it will get indexed like the other posts and pages.

    Thanks
    Jay

    Hi there,

    Thanks for the follow up.

    Please let us know how this goes.

    Thank you.

    Hello,

    I have performed URL inspection of all the URLs on google search console, all looks good except the URL for page foodie map, do you still think it is a timing issue and I should give it a few more days?

    I have also performed a google mobile-friendly test and unfortunately, most of the URLs are not passing the test due to robots.txt, please could you advise how this could be resolved.

    Thanks
    Jay

    Just to add a bit more information to my previous message, in Rank Math SEO Title and Meta under Global Meta, I have Noindex Empty Category and Tag Archives turned on, can this be the cause of the issue of robots.txt on the page foodie map?

    Todd
    Rank Math free

    Hi,

    I still do not see any noindex tag:
    null

    Your robots.txt file doesn’t show any anomaly either:
    https://internationalfoodieguide.com/robots.txt

    The same can be verified on this 3rd party website as well:
    https://seositecheckup.com/seo-audit/noindex-tag-test/internationalfoodieguide.com/foodie-map

    But, your page is showing a 404 status code:
    null

    You must check where that is coming from because it is not coming from Rank Math.

    I would start by disabling all plugins, switching to 2020 theme.

    Then, enable each plugin one by one until you find the problematic plugin.

    Do let us know how it goes.

    Hi Todd,

    Thanks a lot for your suggestions, I looked into this closely and firstly checked my theme settings, the issue was Error 404 Page was set to foodie map, I have now changed that to the custom 404 page I created and rechecked on google search console URL inspection the page is now on google.

    Thanks for your help, I really appreciate it.

    Thanks
    Jay

    Hello,

    We are super happy that this resolved your issue. If you have any other questions in the future, know that we are here to help you.

    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.

    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘URL is not on Google indexing error’ is closed to new replies.