Hello,
I’m sorry to hear that you are facing the "Robots.txt unreachable" error. This error can occur when search engine crawlers are unable to access your robots.txt file. To resolve this issue, you can follow these steps:
- Ensure that your robots.txt file is accessible at the root of your domain (https://rankmath.com/kb/fix-submitted-url-blocked-by-robots-txt-error/#error-meaning).
- Check if there are any issues with your server configuration that might be preventing access to the robots.txt file.
- Verify that there are no directives in your robots.txt file blocking search engine crawlers.
If you are still experiencing difficulties after checking these steps, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.
Thank you for reaching out, and we appreciate your patience.
Sources:
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math
How to Fix the "Indexed, though blocked by robots.txt" Error » Rank Math
Hello,
We checked your robots.txt file and we can see it is working properly without any issues:
In this case, please try to clear your website cache including any server-level cache, and check again.
Looking forward to helping you.
thank you for reply, sir i know that my robots is working but, see history in image ( https://imgur.com/8UqGUKa ), it got unfetch automatically i have to fetch every time this is the problem please help
Hello,
It seems like you’ve marked this ticket as resolved.
Can you please confirm if you still need our assistance with this issue or anything else?
Looking forward to hearing back from you.
Thank you.
