-
Hello,
I deleted the existing robots.txt file from my website and now accessing /robots.txt returns 404 Not found instead of the default robots.txt. I have tried to add rules from the RankMath plugin in WP Dashboard but it still seems to return 404.
I believe the file should be auto created when a physical robots.txt file isn’t found in the website directory.
Please provide a solution. Thanks.
-
Hello,
Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.
Yes, Rank Math should create a default robots.txt virtually on your site if there’s no existing static robots.txt file in your website’s root directory.
Could you please check if your site’s directory is under the root? Or you are using a subfolder for that site? Please also share your website URL so we can check.
You can add it in the sensitive data section
It is completely secure, and only our support staff has access to that section.
Looking forward to helping you.
Thank you.
Hello,
Please resave the permalinks(without changing anything), then clear your website and browser and try accessing the robots.txt file.
If the issue persists, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.
Please do take a complete backup of your website before sharing the information with us.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
We really look forward to helping you.
The ticket ‘robots.txt returns 404’ is closed to new replies.