Robots.txt Tester and Validator math rank

Hello, we apologize for the issue you are facing with the robots.txt file. To resolve the "Access to this page is forbidden" error, you will need to check and possibly edit your robots.txt file to ensure that it is not blocking Googlebot or other search engines from accessing your pages.

Here are the steps you can follow to test and correct your robots.txt file:

1. Open the Robots.txt Tester: Go to the robots.txt testing tool.
   

2. Enter Your Site URL: Input the URL of your site that you want to test.
   

3. Select User-Agent: Choose the user agent you want to simulate (e.g., Googlebot).
   

4. Validate Robots.txt: Click the TEST button to see if there are any rules blocking access.
   

5. Edit and Debug: If the tester finds any rules preventing access, you can edit those rules directly in the code editor. After making changes, run the test again to ensure that access is allowed.

6. Export Changes: If you make any modifications, remember to copy and paste the updated content back into your website’s robots.txt file through Rank Math SEO → General Settings → Edit robots.txt in your WordPress admin area.
   

If you continue to face difficulties or if this issue is affecting a specific page, please reply to this ticket with the URL of your site so that a human agent can assist you further. Thank you for raising this concern!

Sources:
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math

Hello,

Thank you for contacting us and sorry for any inconvenience that might have been caused due to this issue.

To help us understand the problem more clearly and provide a quick and smooth solution, please elaborate more on the issue you are experiencing.

Please send screenshots showing the exact problem and, if possible, a recorded screencast video demonstrating the issue.

You can use tools like Imgur for screenshots or Loom for screencasts.

We look forward to helping you further.

Thanks.