Problem with robots.txt

#89081
  • Resolved myheartontravel
    Rank Math free

    It seems that there is no effect of the indexing option I select for my pages in the SEO tab of Elementor. The robots.txt still remains the same.

    This is driving me crazy as I did not see any robots.txt file in the file manager and later came to know that WordPress manages it. However, I created one manually but even still if I select no-index in the SEO tab of my page, it is having no effect in the actual live URL of robots.txt

    What am I doing wrong?

Viewing 5 replies - 1 through 5 (of 5 total)
  • Alberto
    Rank Math business

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    The changes you do in the indexing options are not saved in your robots.txt but in the meta robots tag inside the page source code.

    About your robots.txt file, Rank Math uses a virtual one (so it only exists when Google (or anyone) queries the site for that file. That is why you don’t see the file and also why you can’t see the changes you do to the robots.txt file inside Rank Math.

    A recommendation, you should remove the robots.txt file you created since if Rank Math detects the file in your system, it won’t use the virtual one.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Alright, so if I delete the one which I created using File Manager, then do I delete the contents which I entered in the “Edit robots.txt” section, or let them be?

    Alberto
    Rank Math business

    Hello,

    If you wish to keep the content of the robots.txt file, you should copy its content before removing the file and then pasting inside the “Edit robots.txt” section.

    Looking forward to help you.

    Thanks. I have copied its contents and renamed the file. pasted it’s content in the β€œEdit robots.txt” section. I think now Rank Math’s virtual one will come into effect.

    Thanks

    Sajid Khan
    Rank Math business

    Hello,

    Please feel free to reply to this ticket when you have an update or open a new one.

    We are here to help.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Problem with robots.txt’ is closed to new replies.