robots.txt

#404336
  • Resolved Harald Marx

    3 years, 6 months ago

    Rank Math free

    Hi there,

    we are testing to change from YOAST to Rank Math. Doing so I get in trouble with the robots.txt.

    I deleted the physical file on the root folder of my site and just confirmed your virtual file in accordance to your implementation guide. But the Google Search Console says that the URL is not available and blocked through the robots.txt. All pages have an index.

    What may be wrong?

    BR Harald

Viewing 7 replies - 1 through 7 (of 7 total)
  • Prabhat

    3 years, 6 months ago

    Rank Math agency

    Hello,

    Thank you for contacting the support.

    Could you please share your website’s URL so that we can have a closer look?

    In the meantime, please clear your website and server’s cache (if any) and see if that helps.

    Looking forward to helping you.

    Thank you.

    Harald Marx

    3 years, 6 months ago

    Rank Math free

    Hi Prabhat,

    txs for assistance.

    The url is: https://villa-intelligentia.de

    I removed the cache of the browser, but this makes no change to the situation.

    BR Harald

    Prabhat

    3 years, 6 months ago

    Rank Math agency

    Hello,

    I checked the robots.txt on your website and it is now the default on with the default/correct rules.

    I also tested your homepage with Google’s Rich Results testing tool and it was crawled properly:

    As you’ve recently updated the robots.txt, please wait for Google to crawl the website again and see if that fixes the issue.

    You can also try the Live URL test using the URL Inspection tool of Google Search Console.

    Hope that helps.

    Thank you.

    Harald Marx

    3 years, 6 months ago

    Rank Math free

    Prabhat,

    I got the same results with the Google´s Rich Results, but still a bad feedback with the Live Url test … so I will wait to see whether Google will crawl the site again.

    What time do you think is apprpriate to retry the status?

    BR Harald

    Prabhat

    3 years, 6 months ago

    Rank Math agency

    Hello,

    Unfortunately, there is no fixed time for the website to get crawled but the status should get updated once Google crawls the website again. I performed another test as Googlebot and the page is accessible without any issues:

    Sure, I suggest you clear your website’s cache and then wait for Google to crawl the website.

    Hope this helps.

    Thank you.

    Harald Marx

    3 years, 6 months ago

    Rank Math free

    Thanks so far,

    I will check the progress what happens and come back to you, if necessary. Perhaps you can leave the ticket open for a while, until I achieved a positive result that the live url test is working.

    BR Harald

    Reinelle

    3 years, 6 months ago

    Hello,

    Sure, we will keep this ticket open, and let us know how this goes.

    Meanwhile, please don’t hesitate to contact us anytime if you have other questions to assist you further.

    Looking forward to helping you.

    Thank you.

    RankBot

    3 years, 5 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 7 replies - 1 through 7 (of 7 total)

The ticket ‘robots.txt’ is closed to new replies.