Hello, we apologize for the issue you are facing with your robots.txt file. The error you’re encountering is due to the incorrect syntax on line 4. In a robots.txt file, you should not include a URL directly; instead, you should use the Sitemap directive to specify the location of your sitemap.
Here’s how you can correct your robots.txt file:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://rankmath.com/kb/indexed-though-blocked-by-robots-txt-error/
Make sure to replace line 4 with the Sitemap: directive as shown above. This should resolve the syntax error. If you have any further questions or need assistance, feel free to reply to this ticket!
Sources:
What Are the Best Robots.txt File Rules for Multisite? » Rank Math
Hello,
Thank you for contacting Rank Math support.
You seemed to have marked this ticket as resolved.
We’re just following up with you to see if you have any other questions or concerns that we can assist you with. Or, if your issue has been resolved, please let us know so we can mark this ticket as closed.
Thank you for choosing Rank Math.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
