Sudden change in robots.txt file

#938749
  • Resolved 小編
    Rank Math free

    Dear team,

    We notice a change in robots.txt file reported by ahrefs audit, but we are not sure why. We fear that this may affect SEO, please provide guideline as how to make sure our robots.txt file is ok?

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    Could you please share a screenshot of the report from Ahrefs so that we can check this further for you? You can use any image-sharing tool like https://imgur.com/upload to share a screenshot with us.

    Also, please share your website URL so that we can check the robots.txt file as well.

    Looking forward to helping you.

    Thank you.

    小編
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Please also advise if such change will negatively affect our SEO?

    Thank you.

    Hello,

    Can you please confirm if you’re referring to the 301 redirection for the robots.txt file? If so, when you look closely you’ll see the robots.txt file is getting redirected from HTTP to HTTPS which is absolutely fine.

    Seems like Ahrefs somehow crawled the HTTP version of your robots.txt file and that’s why it is showing the redirection. You can safely ignore this error.

    Hope that helps and please don’t hesitate to let us know if you have any other questions.
     
    Thank you.

    小編
    Rank Math free

    ok thank you!

    Hello,

    We are glad that helped.

    Please feel free to reach out to us again in case you need any other assistance.

    We are here to help.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Sudden change in robots.txt file’ is closed to new replies.