sitemap and robots.txt

#289477
Viewing 15 replies - 1 through 15 (of 20 total)
  • Prabhat
    Rank Math agency

    Hello,

    Thank you for contacting us and we regret the inconvenience caused.

    I checked your sitemaps and was able to replicate the issue. A 404 page is returned on accessing the sitemap.

    Please follow the below steps and see if that fixes the issue:
    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/pipRDp

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    3. Clear your website’s cache and remove all the sitemaps from your Google Search Console account, and then submit only the main sitemap (your-domain.com/sitemap_index.xml) (please ensure to replace “your-domain.com” with your actual domain).

    Further, give Google some time to crawl your website again and see if the issue gets fixed.

    Hope this helps.

    Thank you.

    Hi Prabhat Rai,

    File save is prompted that this code is wrong.
    sitemap?\.xml?
    [a-z0-9_\-]*sitemap[a-z0-9_\-]*\xml|xsl)?
    ([a-z0-9_\-]*?)sitemap([a-z0-9_\-]*)?\xml

    Best Regards
    Regan

    Azib Yaqoob
    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    Could you please confirm if you are using the correct sitemap URL to submit in the Search Console, which is: https://www.hongshunmed.com/sitemap_index.xml

    I have also validated your sitemap here, and it does not show any error:

    Your robots.txt is showing the incorrect sitemap URL too. Please head over to Rank Math > General Settings > Edit Robots.txt and change the sitemap URL to the one I shared.

    After that, submit the same sitemap URL to Search Console.

    We hope that helps. Please don’t hesitate to contact us again if you need further assistance.

    ​​​​​​​

    Hi Azib Yaqoob,

    Good day to you.
    https://www.hongshunmed.com/error/?preview_id=20939&preview_nonce=4dfa362b79&_thumbnail_id=-1&preview=true
    I mean this code is wrong, kindly check the photo.

    Best regards
    Regan

    Hello,

    While trying to preview the link you shared, getting this error:

    We might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Thank you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hi Abdullah Al Noman Prince,

    Good day to you.

    Hope you can solve my problems. We showed Sensitive Data, kindly check it.

    Best regards
    Regan

    Hello,

    Upon investigation, we found you are using Siteground Optimizer.

    With SiteGround’s SuperCacher system, you can use wildcard characters to easily exclude entire sitemaps from being cached.

    I have added this URL to exclude all the sitemaps. Specifically, all the URLs that have the word “sitemap” in them.
    https://www.hongshunmed.com/*sitemap*

    Here’s the section in the article that gives more details about this:
    https://www.siteground.com/tutorials/wordpress/sg-optimizer/supercacher/#:~:text=In%20addition%20to%20exact%20URLs%2C%20you%20can%20use%20the%20wildcard%20sign%20%E2%80%9C%20*%20%E2%80%9D%20to%20exclude%20entire%20sections%20of%20your%20site.

    Hope this helps. Please do not hesitate to let us know if you need our assistance with anything else.

    Thank you.

    Hi Abdullah Al Noman Prince,
    Thanks a lot.

    Because we have received many solutions from Rank Math Team before, you should be able to browse these solution. Now you now understand that we are using Siteground Optimizer, which solutions need to be continued, and which solutions need to be stopped and deleted?

    We searched through Google, but still can’t find any website information?

    Thanks
    Regan

    Hello,

    The exclusion rule of the sitemap URL varies according to the Plugin you are using. We haven’t yet added the exclusion rule for Siteground Optimizer. Hopefully, it will be added soon in the near future.

    For now, you don’t need to add anything as I have already added it for you.

    If you are using Cloudflare you should also exclude the sitemap from being cached following the article which was shared by my colleague here.

    Hope this clarifies your doubts. Looking forward to helping you.

    Thank you.

    Hi Abdullah Al Noman Prince,

    Thanks for your efforts.

    If Cloudflare can help our website to be indexed by Google, we are happy to do it.
    Frankly wo did it before, but when we added the code (Performance > Page Cache > Never cache the following pages), When saved, it prompts that this code is wrong, so we deleted the Plugin. How we will do now?

    Regarding the Rank Math Pro, can strengthen our SEO?

    Best Regards

    Hello,

    For your initial concern about HTTP error upon submitting your sitemap, it seems that you’re using SiteGround on your site.

    We have received a similar case from one of our users and mentioned that this is an internal issue with SiteGround.

    Here’s an article about this issue as well:
    https://www.searchenginejournal.com/siteground-problem/426852/#close

    For the difference between Rank Math Free and PRO, you can check this link:
    https://rankmath.com/free-vs-pro/

    You can also check my colleague’s summary at this link on how Rank Math PRO can help strengthen your website’s SEO.

    I hope that helps.

    Thank you.

    Hi Reinelle,

    Regarding the add code (Performance > Page Cache > Never cache the following pages), When saved, it prompts that this code is wrong, so we deleted the Plugin. Do we need to keep doing? This is the link from your colleague: https://rankmath.com/kb/exclude-sitemaps-from-caching/

    How we will do now?

    Thanks and Best Regards
    Regan

    Hello,

    You are using Siteground Optimizer Plugin, for which we have already added the URL mentioned in the previous reply.

    There is no such directory for adding this rule in this plugin. The URL we added by going WordPress Dashboard > Siteground Optimizer > Caching > Exclude URLs from Caching.

    Cloudflare does not cache sitemaps by default, so you won’t have to do anything. However, if you’ve made some changes in the settings that are causing sitemaps to be cached, you can set a page rule inside your Cloudflare account and add the following code snippet there.

    Here is a guide about Cloudflare:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/#cloudflare

    Hope that helps. Looking forward to helping you.

    Thank you.

    Hello,

    Upon checking I found your site is not verified by Google and also not indexed yet.

    I checked your homepage’s source code and found the page is already set as index.

    As your website is not added to Google Search Console, here is a tutorial on how it goes with Rank Math:
    https://rankmath.com/kb/google-site-verification/

    Hope this helps. Looking forward to helping you.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 15 replies - 1 through 15 (of 20 total)

The ticket ‘sitemap and robots.txt’ is closed to new replies.