Sitemap could fetch – Blocked by Robots.txt

#766156
  • Resolved Neenad Rajagolkar
    Rank Math free

    Im getting a Couldnt Fetch General HTTP error when i submit the sitemap to Search console.

    When i checked further, it showed that the sitemap is blocked by robots.txt

    What is the solution ?

    Link of error here- https://ibb.co/b5PhvDs

Viewing 4 replies - 1 through 4 (of 4 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    Please share your sitemap URL so we can check and verify the issue.

    Meanwhile, please ensure that you are submitting your sitemap properly and not inspecting it.

    Here’s a guide you can follow:
    https://rankmath.com/kb/submit-sitemap-to-google/

    Looking forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    of course, I have submitted the data coorctly and have done the same many times – its the first time i got this error .
    Link – https://ibb.co/LNsMp7B

    Hello,

    We’ve checked your sitemap, and it is already working fine. You can also validate it using this tool:
    https://www.xml-sitemaps.com/validate-xml-sitemap.html

    However, your robots.txt contains a disallow all rule for all bots and crawlers.

    In this case, please update it to our default and recommended rules:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    
    Sitemap: https://www.winepalacegoa.com/sitemap_index.xml

    Here’s a guide on how to update your robots.txt using Rank Math:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

    Once done, clear your website and server’s cache, then remove your sitemap in your Google Search Console and resubmit it.

    Hope that helps.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 4 replies - 1 through 4 (of 4 total)

The ticket ‘Sitemap could fetch – Blocked by Robots.txt’ is closed to new replies.