Google Search Console is Showing “Failed: Robots.txt unreachable”

Hello, I’m sorry to hear that you’re experiencing issues with Google Search Console. The “Failed: Robots.txt unreachable” error can prevent your pages from being crawled and indexed by Google. To resolve this issue, you’ll need to ensure that your website’s robots.txt file is accessible and properly configured.

To check if your robots.txt file is causing the issue, you can use the robots.txt testing tool from Google. Here’s how you can do it:

1. Open the robots.txt Tester.
   

2. Enter the URL of your site in the tool for testing.
   

3. Select the user-agent (Googlebot) from the drop-down menu to simulate Google’s crawler.
   

If you find that there are directives in your robots.txt file that are blocking Googlebot from accessing your site, you will need to remove them or replace them with a more permissive one.

Additionally, you can also use Rank Math’s Analytics to identify the pages with the problem. Navigate to Rank Math SEO → Analytics in your WordPress dashboard and click on the Index Status tab to get real data/status of your pages as well as their presence on Google.

I hope this helps you resolve the issue. If you have any further questions or need additional assistance, please feel free to ask.

Sources:
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
Why Did My Website Disappear From Google Search? » Rank Math
How to Fix the “Indexed, though blocked by robots.txt” Error » Rank Math