Sitemap not including all URLs

#310856
  • Resolved Marjolein
    Rank Math free

    Hi team,

    My sitemap is not including all my URLs, I’ve edited the code to .htaccess that you suggested in this article. Still, not all URLs are indexed, so it seems to be another issue.

    Could you please assist?

    Edit: I’ve double-checked if the settings are right and I’ve cleared the cache as well. Still the same issue.

Viewing 15 replies - 1 through 15 (of 15 total)
  • Hello,

    Thanks for contacting us and sorry for any inconvenience that might have been caused due to that.

    I can check that you have two web-story sitemaps. Please check the screenshot in the sensitive data section.

    Rank Math creates multiple sitemaps according to the limit you have set in WP Dashboard > Rank Math > Sitemap Settings > Links per Sitemap.

    So there is nothing to worry about as when you submit your main sitemap, Google will read all the sitemaps inside it.

    Hope this clarifies your doubts. Let us know if you need any other assistance.

    Thanks a lot, I didn’t notice that. Is there a reason for it to be better to have multiple sitemaps? I’d prefer to have everything in one sitemap if that doesn’t cause any issues down the road

    Anas
    Rank Math business

    Hello,

    We’ve observed that Google responds better to smaller pages in sitemaps. Thus, the default links per sitemap are set to 200.

    However, if you don’t want to have sub-sitemaps, you can increase the links per sitemap at WP Dashboard > Rank Math > Sitemap Settings > Links per Sitemap.

    Hope that helps.

    Thank you.

    Thanks a lot, I will keep the multiple sitemaps in that case. However, I noticed when looking at my sitemaps that multiple articles are missing. I have around 500 published, and my sitemap index only shows around 350. Could you please assist with that?

    Anas
    Rank Math business

    Hello,

    It seems like your sitemap is getting cached. Please add this filter in the theme’s functions.php file:

    add_filter( 'rank_math/sitemap/enable_caching', '__return_false');
    

    You can follow this guide to add the filter:
    https://rankmath.com/kb/wordpress-hooks-actions-filters/#functions-php-file

    Once done, clear your website and browser cache and check the sitemap.

    Looking forward to helping you.

    Thanks for your quick reply. I’ve added the code in the Child theme (Theme Editor > functions.php > pasted the code), cleared cache, opened the sitemap in an incognito window, and I still see the same output. Is there anything I’m missing here?

    Anas
    Rank Math business

    Hello,

    The cache could be via a plugin or from the server. If you are using Cloudflare, please exclude the sitemaps from caching from Cloudflare by following this guide:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/#cloudflare

    Then, purge the cache from Cloudflare and check the sitemap.

    Let us know if the issue persists.

    We are here to assist you.

    I didn’t change anything in my Cloudflare settings, but I’ve adjusted it and cleared my Cloudflare cache to be sure. Also, I’ve already done point #1 of the link you’ve sent earlier today. Still the same issue unfortunately

    Anas
    Rank Math business

    Hello,

    We might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Anas
    Rank Math business

    Hello,

    You are using NGINX server, you may need to add the following code to your configuration file:

    # START Nginx Rewrites for Rank Math Sitemaps
    rewrite ^/sitemap_index.xml$ /index.php?sitemap=1 last;
    rewrite ^/([^/]+?)-sitemap([0-9]+)?.xml$ /index.php?sitemap=$1&sitemap_n=$2 last;
    # END Nginx Rewrites for Rank Math Sitemaps
    

    If you are not sure, you can ask your web host to add these rewrite rules.

    Also, make sure that the server is not caching the sitemaps.

    Let us know how it goes.

    We look forward to helping you.

    Hi Anas, the code is added by my host, cleared the cache, and still the sitemap is not complete

    Hello,

    I have flushed your sitemap following this guide and it seems all posts are included in your sitemap just fine. Please check it from your end too.

    Hope this helps. Looking forward to your update.

    Thank you.

    Hi Abdullah,

    Thanks for your reply. I see it’s updated, thanks for your help!

    Hello,

    Please clear your browser cache or try to access your sitemap in another browser.

    Hope this will fix the issue. Looking forward to helping you.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 15 replies - 1 through 15 (of 15 total)

The ticket ‘Sitemap not including all URLs’ is closed to new replies.