-
Hello Team,
Wondering if you could assist with an issue I can’t seem to resolve, Google can’t seem to crawl and fetch the robots.txt file. Which in-turn I’m getting an error when indexing within GSC.Everything looks correctly set up but there must be something conflicting. Oh the site is uhyhnseq.com.au
Thanks team!
-
Hello,
Thank you for contacting Rank Math, and sorry for any inconvenience caused.
I checked the robots.txt file, it is correct and loading fine in the browser:
Could you please share the error that is reported in the Search Console?
We look forward to helping you.
Hello,
Your website’s robots.txt file is loading correctly in browsers. I went ahead and tested it in HTTP status and robots.txt validator and both testers are not throwing some issues as you can see in my screenshots:
Upon checking your video screencast, it seems the issue is pointing to your host. I would suggest that you contact your hosting provider and ask what prevents Google from properly crawling your robots.txt. There must be some series of downtimes in your server when Google is trying to access your robots.txt.
Let us know how that goes. Looking forward to helping you.
The ticket ‘robots.txt’ is closed to new replies.