Robots.txt is redirecting to the home page

#336617
  • Resolved phvntominc

    2 years, 11 months ago

    Rank Math free

    Hey all, we decided to try Rank Math instead of Yoast on our latest client’s website. It’s pretty good so far.

    However, we got a notice from SEMrush that our Robots.txt was malformed. Upon inspection, it just redirects to the home page. That could present some SEO issues. What would cause it?

    General info:

    – No, there’s not a file in the root directory. This is for the virtual one in Rank Math.
    – We deactivated all the suspected plugins to rule out conflicts but the problem persists.
    – .htaccess appears to have a pretty standard configuration.

    I’ll dump the site report into the sensitive data.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Kamlesh

    2 years, 11 months ago

    Rank Math free

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    I have checked your site’s robots.txt file ([Moved to Sensitive data section]
    ) and it is working fine for me.
    [Moved to Sensitive data section]

    The above link is not redirecting to the home page of your site.

    Could you please clear your browser cache or check for the robots.txt file in an incognito window?

    Looking forward to helping you. Thank you.

    phvntominc

    2 years, 11 months ago

    Rank Math free

    That’s very odd… I tried it in incognito mode on both Safari and Chrome but the issue persists. I also tried it on an iPhone but it’s still getting redirected.

    Does it need a certain user agent?

    Kamlesh

    2 years, 11 months ago

    Rank Math free

    Hello,

    The robots.txt file should open just fine on any device/browser.

    Could you please clear your site cache, and recheck the robots.txt file?

    I have checked the link -[Moved to Sensitive data section] in Chrome, Mozilla Firefox, and Safari, and it is working fine for me.

    Looking forward to helping you.

    Thank you.

    phvntominc

    2 years, 11 months ago

    Rank Math free

    Ah, flushing Cloudflare fixed it… Short n’ simple. Thanks!

    By the way, could you please redact the client’s web address and screenshot? That would be much appreciated!

    Anas

    2 years, 11 months ago

    Rank Math business

    Hello,

    We are glad the issue is resolved.

    We have removed the screenshot and URLs from the ticket.

    If you have any questions in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

You must be logged in to reply to this ticket.