robots.txt file is unreachable

#290394
  • Resolved SOURAV KUMAR PAUL
    Rank Math free

    From last 4 days, in my website https://thehomoeopathy.in I received the notification on my Adsense homepage,”You have ad crwaler errors,which can result in lost revenue”.When I clicked on Action ,I got the error “Robots:robots.txt Unreachable”.When Igo to the robots.txt tester on Search Console, I get the message”You have a robots.txt file that we are currently unable to fetch.In such cases we stop crawlingyour site until we get hold of a robots.txt, or fall back to the last known good robots.txt file.” Also when I check the sitemap url in url inspection in search console show the message “sitemap couldn’t fetch”. I don’t change anything in sitemap or robots.txt file. Then what is the cause os these errors? Please help my adsense revenue become zero & no Google ad running in my new posts, where as ads are running in old posts and pages.Please guide me. I put the sitemap link below in sensitive data box.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thanks for contacting us and sorry for any inconvenience that might have been caused due to that.

    I can check that your robots.txt file and sitemap are working fine. I can also check that you are using SiteGround as your hosting provider. This is a known issue with the sites hosted on SiteGround. You can check this article for more info: https://www.searchenginejournal.com/siteground-problem/426852/

    You will have to wait for SiteGround to resolve this issue.

    Hope this helps. Let us know if you need any other assistance.

    Hi, I already contacted with siteground support team, they totally check my site, but they told there is nothing wrong from there end.From last 2 years there is no problem, all are running smoothly, I don’t change anything, then these errors happen suddenly from last 4 days. Siteground says after checking there is no problem from there end…then what to do, please guide..

    Hello,

    I have checked your sitemap and robots.txt file and there is no issue. It is an issue that is happening with the site’s hosted on SiteGround. You can check their official Twitter statement here: https://twitter.com/SiteGround/status/1458467145734660099

    Almost all the sites hosted on SiteGround are affected by this issue. I hope they will be able to resolve this soon.

    Please don’t hesitate to get in touch in case you need any other assistance.

    Thanks.

    Ok, thanks Jaideep for the information.

    Hello,

    You can try replacing your SG nameservers with Cloudflare as some users have been able to resolve the issue using Cloudflare.

    Hope this helps. Let us know if you need any other assistance.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘robots.txt file is unreachable’ is closed to new replies.