Hello,
Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.
We tried to load your sitemap and it’s loading fine without any 404 errors at the moment.
As for the other issue with indexation, please add the sitemap entry on your robots.txt file and make sure that the sitemap submitted on GSC is the correct one by following this tutorial: https://rankmath.com/kb/submit-sitemap-to-google/
Hope this helps solve your issues.
Don’t hesitate to get in touch if you have any other questions.
Thank you for your reply.
Yes i also can read my sitemap but every day i have 404 errors from these url :
sitemap.txt
sitemap.xml.gz
sitemaps.xml
atom.xml
For the indexation my sitemap is already on the robots.txt file. My sitemap on the GSC is the correct one. I also resubmit it but doesn’t change anything.
Can you help me?
Many thanks in advance.
Hello,
1. These are not the URLs/slugs of Rank Math sitemaps. As you already know, you access your main sitemap on the URL your-domain.com/sitemap_index.xml.
As you’re getting these errors in the 404 Monitor, a user or bot might be trying to access the URL.
You can get further insight into them by enabling the advanced monitor at WordPress Dashboard > Rank Math > General Settings > 404 Monitor:
https://rankmath.com/kb/monitor-404-errors/#advanced-404-monitor
That will give you more information like referrer and user-agent.
You can also fix these errors by redirecting them to a related page on your website:
https://rankmath.com/kb/fix-404-errors/
With that being said, please note that we only report the 404s. We do not have information on how or why they are generated.
2. Could you please share some of the affected URLs so that we can check them on our end?
Looking forward to helping you.
Thank you.
Hello
The 404 errors comes from the : bingbot 2.0 | Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
I have not yet configured the bing search tool in rankmath, so it might be because of that.
For the other subject, in the GSC all my URL are “Indexed, not submitted in sitemap”. No one are from the “Submitted and indexed” even though the sitemap has been successfully submitted in the search console. The sitemap is correctly in the Robot.txt file.
What can i do to make sure that my URL are in the “Submitted and indexed” category?
Many thanks in advance.
Hello,
Indexed, Not Submitted in Sitemap is not an issue, it only means that Google has already indexed the posts/pages but not through the sitemap.
It is possible that Google is crawling your website and indexing the posts, pages through the internal links on your website and not through the sitemap, and as a result, the crawl budget for your website is exhausted and Google is not able to discover the URLs through your sitemap.
There is nothing to worry about as long as the posts/pages are getting crawled and indexed.
Please exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
https://rankmath.com/kb/exclude-sitemaps-from-caching/
Once done, clear the website cache and resubmit sitemap_index.xml and wait for Google to crawl the sitemap.
I hope this helps. Looking forward to helping you.
Hello
Yes i have already exclude the sitemap from my caching plugin by added the extracode to my plugin. Unfortunately i have not access to my htaccess file so i can’t modify it.
It is necessary to change both code (from htaccess and plugin) to fully exclude sitemap from caching?
Many thanks in advance.
Hello,
Normally, excluding your sitemaps through your caching plugin is enough.
However, if the issue still persists even after excluding your sitemaps from being cached with your caching plugin, then you may need to add the codes in your .htaccess file.
For assistance, you can get in touch with your web host to exclude your sitemaps from any server-level caching.
I hope that helps.
Thank you, and please don’t hesitate to contact us anytime if you need further assistance with anything else.
Thank you, but i didn’t understand everything in your previous messages.
Do you think that in the GSC all my URL are “Indexed, not submitted in sitemap” and no one are from the “Submitted and indexed” might be due to the fact that my sitemap is not correctly exclude from the cache?
Many thanks in advance.
Hello,
No, it just means that the URLs are indexed but they were not crawled from your sitemap, rather, they’re crawled via other resources like internal links.
Since you had not mentioned the Sitemap URL in your robots.txt file, you were missing an instance to present the sitemap URL before the bots while your website was getting crawled. Please ensure that it is now added.
However, as mentioned by my colleague, there is nothing to be worried about as long as the posts/pages are getting crawled and indexed on the SERPs.
As for excluding the sitemaps, it is only recommended since a sitemap should always be up to date with the links to the pages, posts, and custom posts on your website, a cached sitemap defeats this purpose.
Currently, as you’ve excluded the sitemaps from your caching plugin, you should give Google some time to crawl your website.
Hope this helps.
Thank you.
The Sitemap URL is well mentioned in my robot.txt file.
Hello,
If you have already mentioned it, then you have set up the sitemap for your website in the best possible way. Please consider giving some time to Google to crawl your pages. Also, note that sitemap is not the only way google index a website. It’s just a way to give google all the URLs to crawl all the important URLs efficiently.
Thank you, and please don’t hesitate to contact us anytime if you need further assistance with anything else.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
