Bing webmaster tool is unable to fetch robots.txt

#517424
  • Resolved Gungl Ákos
    Rank Math free

    When I am checking my robots.txt file in Bing webmaster tool robots.txt Tester it’s showing an error robots.txt is not found.

    While my robots.txt is available in the root directory and accessible in the browser as well as accessible in google etc. Then why is bing showing such an error?

    With googlebot is all ok

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    I’ve tested your robots.txt, but it seems to be working fine. You can also use this tool and select Bingbot as the user agent, and the result is the same:
    https://technicalseo.com/tools/robots-txt/

    For initial troubleshooting, please try clearing your website’s cache and add these rules in your robots.txt:

    User-agent: Bingbot
    Allow: /

    Let us know how this goes.

    Thank you.

    still nothing…
    even though the test you sent says it’s fine, Bing Webmaster Tools doesn’t find it. That would be the point, no matter what other devices see

    picture

    Hello,

    It seems that Bing looks for a physical robots.txt file in your website’s root directory based on their guide:
    https://www.bing.com/webmasters/help/how-to-create-a-robots-txt-file-cb7c31ec

    Could you please try creating the robots.txt file and copy the rules from Rank Math? Once done, clear your website’s cache and check again.

    Let us know how this goes.

    Thank you.

    i created the file but nothings hapend

    Hello,

    I tested your robots.txt file using several tools for Bingbot and I found no issues there.

    Please check them here:
    https://i.rankmath.com/i/AKC5fl
    https://i.rankmath.com/i/oKcTEu

    Please raise a question in Bing support to see if you can find a solution for this issue.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Bing webmaster tool is unable to fetch robots.txt’ is closed to new replies.