Sitemap index can be read, but has errors : General HTTP Error

  • I actually uploaded my sitemap one month ago and it should’ve been fine, so I didn’t look at google console anymore, but for some reason, my new pages didn’t show up in google index, so I had a look at my Google Search Console and I’ve seen that my site hasn’t been crawled since 5th of may… So I all my new posts and pages are not even found by Google.

    I saw there was an error, so I deleted the new sitemap and added a new one, the correct one. The sitemap seems to look fine, but for some reason, I still get the same error and it’s not being crawled.

    Does anyone have any idea how to fix this?


Viewing 4 replies - 1 through 4 (of 4 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    I have just tested the curl response to your sitemap file and it looks like your server is caching this document. Please get in touch with your host to bypass the file.
    You will also need to flush your permalinks to serve the updated URLs on your sitemap by heading over to Dashboard > Settings > Permalinks and hit save.

    I hope this info helps. Thank you.

    ​​​​​​​

    I contacted my host and they’ve said this:

    “I do not see how the caching would be causing this issue, as it is working the same for all the websites. But to test out and be sure, I can disable the caching from our end for the brainiosity.com website and this way we can be sure if it is caching related or not.”

    Hope it works, but somewhere skeptical right now.

    Anything else I should do or just wait?

    Hello,

    Once the cache is disabled, please submit it to Google once again.

    Even having a sitemap doesn’t guarantee indexing. You can maybe try our instant indexing API and see if that helps.

    How You Can Get Google To Crawl Your Website Instantly

    There are a few things you must check for in order to see why the posts aren’t getting indexed.
    1. Make sure the post is not selected as ‘noindex’ in WP > Posts > Your Post > Advanced Tab in Rank Math.
    Screenshot: http://i.mythemeshop.com/2tVI31
    2. Ensure that the noindex is not selected for Global or Posts meta: http://i.mythemeshop.com/b9kMVI
    3. Check the sitemap settings and check if the posts are setup to be included in the sitemaps: http://i.mythemeshop.com/KRxIvR

    Please note that it is completely upto Google if they want to index or not index your website. So, if you haven’t willingly or accidentally made your posts noindex and Google still isn’t indexing your page – it means that either Google doesn’t want to index or hasn’t crawled your page yet because it hasn’t allocated that much crawl budget to your website.

    Please check this website for more details:
    https://www.searchenginejournal.com/definitive-list-reasons-google-isnt-indexing-site/118245/

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 4 replies - 1 through 4 (of 4 total)

The ticket ‘Sitemap index can be read, but has errors : General HTTP Error’ is closed to new replies.