Hello,
Thank you for contacting Rank Math and apologies for any inconvenience that might have been caused due to that.
1. Can slow sitemap generation cause any SEO Indexing Issues?
Yes, a slow-loading sitemap can timeout and cause issues with attempts by search engines robots to crawl it.
2. Can you help me to speed up the sitemap generation for a large website?
There are several factors that speed up sitemap generation. First, you can make sure your server has all the right requirements. You can check that by going to WordPress dashboard > Tools > Site Health > Info tab > Server
If the values are low, please contact your web host and ask them to set the following values:
PHP Memory Limit: 512M
Max input time: 150
PHP time limit: 120
PHP max input variables: 1000
Then please make sure your links per sitemap are not too large. Google crawls small-sized sitemaps faster. With this in mind, Rank Math uses the links per sitemap limit to break down sitemaps into smaller parts. You can also check Google’s guidelines for large sitemaps:
https://developers.google.com/search/docs/crawling-indexing/sitemaps/large-sitemaps
Please set your Links per sitemap between 200 and 500 in Rank Math > Sitemap Settings > General, and let us know if the issue still persists
https://rankmath.com/wp-content/uploads/2021/02/links-per-sitemap.jpg
As you are using Cloudflare, it’s taking time to access your sitemap URL. Also, after checking your sitemap URLs as Googlebot, I found that it’s returning a 403 error because Cloudflare is blocking Googlebot from accessing your sitemap URLs. You can check the image links below for reference:
https://ibb.co/TTzxv95
https://ibb.co/47pGMgz
https://ibb.co/RjsFC8b
https://ibb.co/2s4Jpw6
In order to fix this issue you can add an exception to Cloudflare for Googlebot.
Looking forward to helping you.
Hi, Sorry for late reply. HI, About Server Issue am using VPS and here a details checked via Site health tool
Server architecture Linux 5.4.0-1074-kvm x86_64
Web server LiteSpeed
PHP version 7.4.33 (Supports 64bit values)
PHP SAPI litespeed
PHP max input variables 1000
PHP time limit 300
PHP memory limit 1G
Max input time -1
Upload max filesize 1000M
PHP post max size 1000M
cURL version 7.68.0 OpenSSL/1.1.1f
Is SUHOSIN installed? No
Is the Imagick library available? Yes
Are pretty permalinks supported? Yes
.htaccess rules Custom rules have been added to your .htaccess file.
Links Per Sitemap set to 200, and I still have that issue.
About Cloudflare, I disabled Under attack mode. Am not sure if the Google bot access have been fixed. may I know what tool you used to check (If it public) so I can test it too
Hello,
We deeply apologize for the delay in response.
I can see that the issue with 403 forbidden with your site is solved now. You can verify that using a tool like https://view.hugo-decoded.be/
Though your child sitemap is loading faster than before. But the main sitemap still struggling a bit to load.
Since you’ve a large number of posts on your site, I suggest you to consult with your hosting provider and asking them to upgrade the limits by the necessary value to see if that resolves the issue for you.
Looking forward to helping you.
Thank you.
Thank you..
I suggest you to consult with your hosting provider and asking them to upgrade the limits by the necessary value to see if that resolves the issue for you.
Which limit should they increase.. I already share my Server info on this thread.. can you tell me which limit should they increase so I can tell them. Thanks
Hello,
This is not only about the limits on the server but also the infrastructure.
For example, you could have huge limits and still run slower than a server with lower limits if the CPU, memory, or any other hardware component on the server is not good enough to handle so much data.
So, our recommendation is that you check with the hosting provider what is the infrastructure and ask for some performance tests so that you can compare it with other services that might offer better infrastructure.
Don’t hesitate to get in touch if you have any other questions.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
