Robots.txt file is missing or unavailable.

#88315
  • Resolved Sheraz Zahid
    Rank Math free

    Hey,
    Unluckily, I reset the rankmath settings and did the setting again but this time I found an error of missing Robots.txt file. The file is still visible in the root folder but in the seo analysis it is showing missing. Can you please help me with this problem? Also I want every post on my website to be shown in the search engine. How can one do that by editing in the robots.txt file?

    Thanks.

    • This topic was modified 3 years, 11 months ago by Sheraz Zahid.
Viewing 13 replies - 1 through 13 (of 13 total)
  • Alberto
    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    If you have a robots.txt available in your root folder, it is not generated by Rank Math since Rank Math uses a virtual one. You should copy its content and remove the file, pasting the content inside the editor you will find in the Rank Math dashboard.

    Also, could you share your website URL (in the Sensitive Data section) so we can check the robots.txt (once you change it to the virtual one)?

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hey,

    I deleted the robots.txt file from the root directory and pasted the contents in the RankMath editor and its still missing.

    Thanks.

    Hello,

    I was able to replicate your issue. Please include FTP access details in the sensitive section with write access and let us knw so we can investigate this issue further.

    Looking forward to helping you. Thank you.

    ​​​​​​

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hey Michael,
    Thanks for quick response. I have added the cpanel access.

    Thanks

    • This reply was modified 3 years, 11 months ago by Sheraz Zahid.
    Alberto
    Rank Math business

    Hello,

    I have sent this thread to our devs so they can take a look at it and hopefully help you with this issue.

    Looking forward to help you.

    Hello,

    I don’t see robots.txt in the root directory on your server. Please add the robots.txt in your root directory where WordPress is setup and run the SEO Analysis again. That should fix the issue.

    Thank you.

    Hey @Pratik
    Isn’t it the robots.txt is automatic from the RankMath?
    If I create a file in the root dir. whether it should left empty or not?

    Thanks

    Hello @Pratik

    I added the robots.txt file in the root dir. but still its not working. Can you help me please with this?

    Thanks

    Hello,

    Sorry for not following up quickly and any inconvenience that might have been caused due to that.

    It seems like the Robots.txt files are loading fine.

    Also, is there a specific reason you installed WordPress inside a directory rather than the root as this might create issues down the line?

    Looking forward to helping you. Thank you.

    Hey,
    thanks for resolving my issue. No there is no specific reason to install inside the directory. I tried to install it in the root dir. but I was facing some issue so I left it in the subdirectory.

    Thanks for help me.

    Hello,

    Happy to help.

    If it isn’t too much to ask for – would you mind leaving us a review here?
    https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post

    It only takes a couple of minutes but helps us tremendously.

    It would mean so much to us and would go a really long way.

    Thank you.​​

Viewing 13 replies - 1 through 13 (of 13 total)

The ticket ‘Robots.txt file is missing or unavailable.’ is closed to new replies.