Sitemap pages return 404 and pages not indexed

#850790
  • Resolved Sameer Ambhore
    Rank Math free

    Hello,

    Bhanu asked me to post my request here.

    None of my pages on https://planet11plus.co.uk are indexed on google – I have requested for a few weeks now.

    The sitemap pages keep breaking resulting in 404 errors almost every day making me reset the Rank Math configuration and saving again after which they become accessible again.

    I have checked that robots.txt has no blocks, the sitemap is correct and the live pages can be successfully tested on Google search centre.
    When testing Live URL I get a conflicting message saying URL is on google.

    I’m stuck now as I have no idea what I should do as there are no errors or anything that I can work on to get this corrected.

    1. Validated sitemap (https://planet11plus.co.uk/sitemap_index.xml). No issues detected but it keeps coming with 404 errors after every 1-2 days.
    2. The Index check box is enabled/checked on the Robots Meta section of Title and Meta.

    Appreciate your support.

    Many Thanks,
    Sameer

Viewing 5 replies - 16 through 20 (of 20 total)
  • Sameer Ambhore
    Rank Math free

    HI There,

    I have gone through your knowledge base and I have taken all the required measures. I have gone one step further and copied the entire website to a new domain and google is able to crawl the pages successfully – it implies there isn’t any problem with the actual content OR quality.
    I’m now on the verge of giving up on this.
    One thing I’ve been desperately looking for is an actual issue OR error that I can fix ( there must be something that’s stopping my pages from being indexed).
    It’s difficult to understand how it’s possible that google doesn’t recognise a single page from the website – but searching for the actual website domain actually gives search results to this post, the other copied website and other support posts that mention my website but none of the pages from my website.

    Many Thanks for your continued support on this.
    Sameer

    Sameer Ambhore
    Rank Math free

    In addition to the above, I do get 404 errors quite frequently when accessing https://planet11plus.co.uk/sitemap_index.xml

    Every time there’s 404 error, I need to go to Rank Math – Sitemap Settings -> Save

    And then it starts working again.

    This is not good – I was hoping great things after installing Rank Math but I’m getting so much trouble even before subscribing for PRO version.

    I hope to get a solution before uninstalling Rank Math.

    Many Thanks,
    Sameer

    Hello,

    The issue with the sitemap is clearly a caching issue since the actions you take to fix the 404 are the ones that clear the caching on them.

    We would recommend that you use the transient method from this tutorial and clear the cache by following he steps you followed before one more time: https://rankmath.com/kb/exclude-sitemaps-from-caching/

    As for the issue with the website not being indexed, as you can see from the results of the homepage the error states the following:

    
    Crawled - currently not indexed
    

    That means that Google is able to see the website but it doesn’t see the content on the page (currently the homepage) to be worth indexing or it’s too complicated to understand the structure of the page.

    There are countless tutorials online about this but this one is one of the most comprehensive: https://www.onely.com/blog/how-to-fix-crawled-currently-not-indexed-in-google-search-console/

    There are no technical issues with the website so that means that our plugin is working as expected, otherwise, you would see other technical errors appearing in the reason for not indexing the pages.

    Don’t hesitate to get in touch if you have any other questions.

    Sameer Ambhore
    Rank Math free

    I do not use any caching plugins due to the dynamic nature of content/quizzes on my website. I used Litespeed a long time ago but removed it as I was not able to exclude some elements on my website that I didn’t want cached.

    Hello,

    Thank you for your patience.

    Please note that the cache could be via a plugin or from the server.

    If you’re not using any caching plugin, you should get in touch with your web host to check and exclude your sitemap URLs from their caching services.

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 16 through 20 (of 20 total)

The ticket ‘Sitemap pages return 404 and pages not indexed’ is closed to new replies.