Sitemap is block by robots.txt

#19081
  • Resolved Jthlau

    5 years ago

    Rank Math free

    Hello Support,

    My problem is my site unable to index by Google Search Console and told me that it’s blocked by robots.txt. (https://jmp.sh/DBa9afg) I’ve tried to solve myself, but seems no luck on that and need your help….

    I install RankMath earlier last month and just not aware that the site is unable to index.
    1) Working backward, first I found it’s from a silly mistake, where I forgot to turn off “Discourage search engines from indexing this site” from WP Dashboard->Setting->Reading
    2) Then I found that my site don’t have a robots.txt file, then I create one (as of the screen cap) and saved in root folder via SFTP. (https://jmp.sh/D3MqPHg)
    3) Check with GSC URL inspection with my landing page (https://fertient.com), found it’s still block by robots.txt (https://jmp.sh/Gv8GaOP). Further check with normal google search, sound it really has problem in crawling. Where the Meta info are those out-dated one created with Yoast long time ago.
    4) Knowing that GSC sometimes need to wait for a while before change made, so I wait for half a day and test again, problem remains……

    Sorry that I’m a beginner in this aspect and have no clue how to solve that….May I have your advise please?

    Thanks,
    Joe

    • This topic was modified 5 years ago by Jthlau. Reason: Forgot to provide wp admin URL
Viewing 2 replies - 1 through 2 (of 2 total)
  • Jthlau

    5 years ago

    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Michael Davis

    5 years ago

    Rank Math pro

    Hello,

    Thank you for contacting Rank Math today.

    I have checked and tested and your site is currently not blocked by robots.txt file. I’ve gone ahead and deleted the robots.txt on the root of your site since Rank Math creates a dynamic file that is easier to manage. I have also deleted the current sitemap and submitted a new one on your search console dashboard. Please give this a few days to fetch all the posts on your sitemap.
    The following error is reported on the enhancements tab “Either “offers”, “review”, or “aggregateRating” should be specified”. I can suggest that you fix this by adding some actual reviews of your WC products to ensure your get some rich snippets.

    Looking forward to helping you. Thank you.

    ​​​​​​

    RankBot

    5 years ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 2 replies - 1 through 2 (of 2 total)

The ticket ‘Sitemap is block by robots.txt’ is closed to new replies.