Ahrefs reports Robots.txt is not accessible

#1017008
  • Resolved Benedict

    1 week, 2 days ago

    Rank Math free

    Hi RankMath team,

    I have a fairly new website. Previously, Ahrefs could crawl the website, but now (20 Apr) it says that Robots.txt is not accessible.

    Could you have a look? I didn’t make any changes to the Robots.txt file after activating RankMath.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Ike

    1 week, 1 day ago

    Hello,

    Thank you for contacting us. We apologize for any inconvenience this issue may have caused.

    Can you share the URL of the affected site with us.

    If you can, please also share a screenshot of the particular report by Ahref.

    You can use this tool to share screenshots with us: https://imgur.com/upload

    We look forward to helping you.

    Benedict

    1 week, 1 day ago

    Rank Math free

    Hi Ike,

    Thanks for getting back.

    The website is chasethetrails.com.

    Screenshot of the Ahrefs report: https://imgur.com/a/EsySqrT

    Ike

    1 week, 1 day ago

    Hello,

    This report might be a false positive, as we checked the HTTP status code using https://httpstatus.io/ and it returned a 200 status.
    https://i.rankmath.com/i/5rLjGx

    You might need to check it again in Ahrefs.

    Don’t hesitate to let us know if you need our assistance with anything else.

    Benedict

    1 week, 1 day ago

    Rank Math free

    Hi Ike,

    I see, noted. Thanks for checking.

    Princess

    1 week, 1 day ago

    Hello,

    Glad that helped.

    Please feel free to reach out to us again in case you need any other assistance.

    We are here to help.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

You must be logged in to reply to this ticket.