Robots.txt file

#233300
  • Resolved Rashed Silva
    Rank Math free

    Semrush told me, I have an error with the robots.txt file ” Sitemap.xml not indicated in robots.txt” what should I do, and what is the ideal robots.txt file

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting the support, and sorry for any inconvenience that might have been caused due to that.

    Could you please share your website URL with us so we can check it on our end?

    You may also check your robots.txt setting under Rank Math > General Settings > Edit robots.txt and leave it empty for Rank Math to generate a standard configuration of robots.txt.

    If that won’t work, then please check if you have a static robots.txt file present in your website directory or FTP and delete it.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    There is no Robots.txt file in my WEBSITE Directory or FTP / In Rankmath robots.txt is empty to auto work from rankmath.

    check out this https://softreno.com/robots.txt

    As you see the sitemap is listed in the robots.txt but maybe semrush could not find it for a certain reason. but what I want to make sure about is, can I write a better thing in a robots.txt file that can be ideal and better for my SEO?

    Hello,

    Thanks for sharing the URL.

    Your robots.txt file has the correct link to your sitemap. Semrush might be checking for the sitemap.xml, which redirects to sitemap_index.xml after you start using Rank Math. So you can simply ignore the warning as you don’t need to change or add anything to your robots.txt file.

    Hope this clarifies your doubts. Let us know if you need any further assistance.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘Robots.txt file’ is closed to new replies.