Hello, I’m sorry to hear that you’re experiencing issues with your robots.txt file. I understand that the robots.txt file is not available at the expected URL and is returning a 404 error.
The issue you’re facing could be due to the presence of another robots.txt file in your site’s root directory, which may be conflicting with Rank Math’s robots.txt file. Since you have access to your WordPress admin and FTP, you can check if there’s another robots.txt file present in your site’s root directory.
If you’re using FTP, you can log into your WordPress root directory and check for the presence of a file named robots.txt. If it’s present, you can delete it to resolve the conflict with Rank Math’s robots.txt file.
Here’s a guide on how to navigate to the root directory using an FTP application: Navigate to File Manager in cPanel.
Once you’ve confirmed and deleted any conflicting robots.txt file, please clear your website and server-level cache and test your robots.txt URL again.
If the issue persists, please let us know, and we’ll be happy to assist you further.
Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
i dont have robots.txt file in my FTP files
ok im waiting a humain reponse right now im redirecting not working link to working link via cloudflare
Hello,
We’ve checked your site, and you’re using Yoast at the moment. Your robots.txt also displays the rules from Yoast.
Let us know if the issue persists while using Rank Math so we can assist you accordingly.
Looking forward to helping you.
yea normal because i didnt get any answer so i switch to yoast
Hello,
That fine. But if you at any time want to switch back to Rank Math and need help with anything – please don’t hesitate to reach out. We’ll be more than happy to help!
Regards,
