I have a problem with robots.txt

#557925
  • Resolved eslam saker

    1 year, 7 months ago

    Rank Math free

    when I test my website by Google tools I found this problem (robots.txt is not valid )
    I can not even find the robots.txt on my website server
    but when I put the path in the browser it opens the file I don’t know why
    please note the problem appears in two Google tools
    robots.txt tester
    and page speed insights I will leave the links
    here is the wired code that appears in the robots.txt tester:

    <!DOCTYPE html PUBLIC “-//W3C//DTD HTML 4.0 Transitional//EN” “http://www.w3.org/TR/REC-html40/loose.dtd”><html><head><meta http-equiv=”Content-Type” content=”text/html;charset=UTF-8″></head><body><p>User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://camfordpublishing.com/sitemap_index.xml</p></body></html&gt;

Viewing 1 replies (of 1 total)
  • Reinelle

    1 year, 7 months ago

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    I’ve checked your robots.txt, and it does not show or include the invalid code <!DOCTYPE.... You can also test that using this tool:
    https://technicalseo.com/tools/robots-txt/

    Please clear your website’s cache and check again the robots.txt. If the issue still persists, try creating a static robots.txt file in your website’s root directory and copy the same content from the generated robots.txt from Rank Math.

    Let us know how this goes.

    Thank you.

    RankBot

    1 year, 6 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘I have a problem with robots.txt’ is closed to new replies.