Erorr with the ROBOTS.TXT file

#520772
  • Hi, for some reason even though I correctly migrated the ROBOTS.TXT file – when I try to view a page on the website – it shows me an error that the page does not exist. I would appreciate your help – thanks!

Viewing 1 replies (of 1 total)
  • Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    I checked your robots.txt, and indeed it is getting an error 404. In this case, please check your Nginx config file and ensure there are no directives blocking robots.txt on your site.

    Meanwhile, /?robots=1 is working to display your robots.txt. You can try adding this rewrite rule on your site and check if the /robots.txt is working properly:

    # START Nginx Rewrites for Rank Math Robots.txt File
    rewrite ^/robots.txt$ /?robots=1 last;
    rewrite ^/([^/]+?)-robots([0-9]+)?.txt$ /?robots=$1&robots_n=$2 last;
    # END Nginx Rewrites for Rank Math Robots.txt File
    

    Here’s how you can edit .htaccess file using Rank Math:
    https://rankmath.com/kb/edit-htaccess/

    Please do take a backup before editing your .htaccess file.

    You can also ask your hosting provider to do that for you.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    ​​​​​​​

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘Erorr with the ROBOTS.TXT file’ is closed to new replies.