-
i change the robots.txt on rank math an on my file manager on my hosting and i still receive this screen shot URL is not available to Google
-
Hello,
I’m sorry to hear that you are still facing issues with the robots.txt file even after making changes through Rank Math and your hosting file manager. To further troubleshoot and resolve the problem, you can follow these steps:
-
Check Robots.txt Tester Tool: You can use the Robots.txt Tester Tool provided by Rank Math to validate if there are any rules blocking Google from accessing your URL.
-
Edit Robots.txt with Rank Math: Ensure that you have correctly edited the robots.txt file using Rank Math. You can access and edit the robots.txt file in Rank Math from WordPress Dashboard → Rank Math SEO → General Settings → Edit robots.txt.
-
Validate Changes: After editing the robots.txt file, save the changes and ensure that the modifications are reflected correctly.
If the issue persists, please provide more details or screenshots of the error message you are encountering so that we can assist you further.
Sources:
I Can’t Edit My Website’s Robots.txt » Rank Math
No Information is Available for This Page » Rank Math
How to Fix the "Indexed, though blocked by robots.txt" Error » Rank Math
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Mathi did change and edited the robots.txt on rank math and i deleted file on my hosting but the google console still see that is is blocked does this take time
Hello,
Could you please share the image of the error? You can upload screenshots using this tool and add the link here.
Meanwhile, please clear your website and server’s cache for troubleshooting,
Looking forward to helping you.
Hello,
It seems you forgot to share the link to the images.
Please share the screenshot so we can investigate the error.
We look forward to hearing from you.
Thank you.
Hello,
While we can access your website on the Opera browser, we checked your website with the Chrome browser and it is stuck while loading and shows the message: Checking your browser before accessing. It is also returning the 403 status.

This type of error is due to the Firewall rule you have set on your website.
Please contact your host to disable this rule and check again in Google
Let us know how it goes. We look forward to helping you.
Thank you.
is that might me due to a wordfence plugin or the host provider
i was redesigning my site so i was working on a staging site and i put it under noindex but when i publish i kept no index on my staging site (subdomain ) and the main site is can be indexed and robots is allow can this be the reason that my main site URL is not available to Google
Hello,
Curiously the meta robot tag on your site doesn’t have the index attribute. It only has the maximum size of an image preview (
max-image-preview:large.

Please ensure you are using the latest version of the Rank Math plugin: https://rankmath.com/changelog/free/
Also confirmed that the “Discourage search engines from indexing this site” option is switched OFF in your WordPress settings.
If the issue persists then it might be caused by a plugin/theme conflict.
To determine that, please follow this troubleshooting guide:
https://rankmath.com/kb/check-plugin-conflicts/Here is a video you can follow as well:
Only the site admin would know and your users won’t be affected by this troubleshooting.
We hope this helps. Please let us know if you have further questions or concerns.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
-
The ticket ‘robotos.txt’ is closed to new replies.