Sitemap couldn’t fetch

#475069
  • Resolved Yu Sze
    Rank Math free

    Dear Rank Math support team

    I have a problem regarding the sitemap in google search console.

    I submitted the sitemaps few days ago, but the status said that couldn’t fetch.

    And I tried to inspect the URL from the search console, the result said “blocked by robots.txt”

    Is there any solution for that?

    Attached herewith the setting from robots.txt in the sensitive data

    Best Regards

    Sze

Viewing 7 replies - 1 through 7 (of 7 total)
  • Hello,

    Thanks for contacting us, and sorry for any inconvenience that might have been caused due to that.

    I checked the robots.txt, you have disallowed / in the robots.txt, which is why the URLs are being blocked by the robots.txt. I’ve attached a screenshot in the sensitive data section for your reference.

    Most likely you’ve a robots.txt file in the root folder of your site. In this case, I would like to suggest you to try applying the recommended robots.txt in to your robots.txt file to see if that fixes the issue for you:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules

    Once done, give Google some time to recrawl your site and re-validate the issues on your Google Search Console account.

    Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.

    Thank you.

    Yu Sze
    Rank Math free

    Hello,

    Thanks for your reply.

    I had adjusted and saved the new robots.txt file, but I checked again with the URL still have disallowed / in the robts.txt, is that normal? Or it needs time to update?

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Anas
    Rank Math business

    Hello,

    Can you please clear the cache from your CDN and your website cache and check again?

    Let us know how it goes.

    We look forward to helping you.

    Yu Sze
    Rank Math free

    Hi,

    I had cleared cache already, but seems still not work.

    Any solution for that?

    Please advise.

    Best Regards

    Hello,

    Please try checking at the root folder of your site to see if have any robots.txt present there. If so, please try editing that file and see if that works.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Yu Sze
    Rank Math free

    Hello,

    I logged into the sftp and checked, I cannot find any robots.txt there.

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Anas
    Rank Math business

    Hello,

    We might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 7 replies - 1 through 7 (of 7 total)

The ticket ‘Sitemap couldn’t fetch’ is closed to new replies.