Issue With New Sitemaps Being Created

#1085959
  • Resolved Anna Kuhl
    Rank Math free

    Hi there

    I have a website that has RankMath installed. The sitemap module is set to limit sitemaps to 200 URLs and I’ve just noticed that there are only 4 sitemaps, each with the max 200 URLs, but there should be 5 sitemaps as this website currently has 909 published pages (all set to index). I’m not sure why it’s stalled at 4 sitemaps?

    https://givemetheanswer.com/sitemap_index.xml

    The extra weird thing is that it seems that it’s the 800 newer pages (the ones published more recently) that are included in the sitemaps and the pages published earlier have dropped out of the sitemaps, although they were definitely in the sitemaps before. Those earlier pages have been crawled and indexed, e.g. https://givemetheanswer.com/ultimate-comic-quiz/ (the homepage was the very first page published and this one was second), so I’m not sure why they’ve been removed from the sitemaps instead of a 5th sitemap being generated?

    I asked RankBot and it suggested:
    1. ensuring the Sitemap module is turned on, which it obviously is.
    2. checking the permalink structure – I resaved on the permalinks page to make sure but no change in the sitemap index.
    3. server configuration – it gave some code to add to the .htaccess file but only for Apache and Nginx servers. This website is on a LiteSpeed server and RankBot said it didn’t have info on what to do in that regard.
    4. check for conflicts, which I did. I deactivated all plugins but no luck. Nothing much changes on this website other than new pages being added (plugins aren’t being added, themes aren’t being changed, etc.)
    5. clear cache – no caching plugin on this particular site.

    Any insight into what’s going on would be much appreciated, as well as any tricks I can try to correct it. TIA.

Viewing 7 replies - 1 through 7 (of 7 total)
  • Hello,

    We apologize for the issue you are facing with the sitemaps on your website. It sounds like a frustrating situation, and we appreciate you providing detailed information about the steps you’ve already taken.

    Here are a few suggestions to help troubleshoot the issue further:

    1. Check Sitemap Settings: Ensure that all post types are included in the sitemap settings. Go to Rank Math SEO → Sitemap Settings and verify that all relevant post types are set to be included in the sitemap.

    2. Flush Permalinks Again: Sometimes, flushing permalinks multiple times can help. Go to Settings → Permalinks and click Save Changes again, even if no changes were made.

    3. Check for Custom Canonicals: If any of your older pages have custom canonical URLs set, they may not appear in the sitemap. Ensure that these pages do not have custom canonicals that could be affecting their inclusion.

    4. Review Robots.txt: Check your robots.txt file to ensure that there are no rules blocking the older pages from being indexed or included in the sitemap.

    5. Inspect Server Configuration: Since your site is on a LiteSpeed server, ensure that it is configured correctly to handle dynamic sitemaps. You might need to consult with your hosting provider for specific configurations related to LiteSpeed.

    6. Check for Errors in Sitemap: Use tools like Google Search Console to check for any errors related to your sitemap submission. This can provide insights into what might be going wrong.

    7. Manual Sitemap Generation: As a last resort, you can try manually generating a sitemap using a different plugin temporarily to see if it captures all pages correctly.

    If these steps do not resolve the issue, we recommend replying to this ticket with any additional details or errors you encounter, and a human agent from the Rank Math Support team will take over and assist you further.

    Thank you for your patience, and we hope to help you resolve this soon!

    I have done all of these steps and have had no luck with getting anything to change.

    For step #7 though, I did deactivate the RankMath Sitemaps module and when I checked the automatically generated WordPress sitemap, it was successfully pulling in all 909 pages: https://imgur.com/a/TZpX6I0.

    Any help in figuring out what RankMath’s issue is with going beyond 800 would be super appreciated.

    Hello,

    If those older posts are missing from your sitemap, then they must be set to noindex or have a custom canonical URL with them.

    Here’s a link for the common reasons why a URL is not included:
    https://rankmath.com/kb/url-not-in-sitemap/

    Looking forward to helping you.

    Thank you for the reply. I’ve already been through that checklist and double-checked all my pages. All pages are set to index and there are no canonical URLs set on any of the pages. https://imgur.com/a/qMRbdOH

    All of those 109 extra pages were showing in the sitemaps successfully before but since I’ve gone over the 800 page count, the sitemaps have only continued to show the 800 most recent pages. Each time I publish a new page, an older one drops out of the sitemap.

    And as I mentioned, if I switch to another sitemap generator plugin, all 909 pages are shown in the sitemap successfully, so I can’t see how it’s not an issue with RankMath if another plugin can do the job?

    I’ve also tried changing the number of URLs allowed in a sitemap to stop RankMath from splitting into multiple page sitemaps. I then went into my hosting dashboard and purged the entire cache at the server level, but RankMath is still splitting into 4 sitemaps of 200 URLs each.

    Any help beyond the standard troubleshooting would be much appreciated. I haven’t had this issue on any other website and I’ve installed RankMath on dozens of sites but I also don’t have any websites with this large a number of pages to compare to.

    Hello,

    Could you please apply the following filter to your site to disable the transients cache for the sitemap and see if that works for you:

    add_filter( 'rank_math/sitemap/enable_caching', '__return_false');
    

    Here’s how you can add a filter/hook to your WordPress site:
    https://rankmath.com/kb/wordpress-hooks-actions-filters/

    If the issue persists, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.

    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    That hook fixed it! 5th sitemap generated and all URLs are now being pulled in. Thank you so much for your help! 🙂

    Hello,

    We’re delighted to hear that this issue has been resolved. We appreciate your feedback.

    This ticket will be closed now, but if you ever have another question or need any help in the future, please don’t hesitate to create a new forum topic. We’ll be more than happy to assist you again.

    Thank you.

Viewing 7 replies - 1 through 7 (of 7 total)

The ticket ‘Issue With New Sitemaps Being Created’ is closed to new replies.