robots.txt is not valid in lighthouse

#274292
  • Resolved Aaron
    Rank Math free

    When running an SEO test in Google lighthouse, I receive the following message:

    -Links are not crawlable
    -robots.txt is not valid

    I have asked my host to flush the server cache, I have added the rules in WP rocket and the robots.txt shows exactly as described in RankMath when visited directly

Viewing 3 replies - 1 through 3 (of 3 total)
  • Prabhat
    Rank Math agency

    Hello,

    Thank you for contacting us and we regret the inconvenience caused.

    Please try accessing the robots.txt file on your website using this URL format:
    your-domain.com/robots.txt.

    Lighthouse shows that error because Rank Math generates the robots.txt file dynamically and there is no physical file present in your site’s root directory to download. However, this does not, in any manner, prevents the bots from crawling the robots.txt file.

    If the robots.txt file loads properly upon accessing the above URL, then you can safely ignore that warning.

    Looking forward to hearing back from you.

    Thank you.

    Aaron
    Rank Math free

    Ok thank you when I visit the /robots.txt the file shows correctly

    Prabhat
    Rank Math agency

    Hello,

    Then you can safely ignore that error.

    Please feel free to get in touch if you require any further assistance.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘robots.txt is not valid in lighthouse’ is closed to new replies.