Unable to generate llms txt file due to blockage

Hello,

We apologize for the issue you are facing with generating the llms.txt file. It seems like there might be a blockage that is preventing the file from being created.

To troubleshoot this issue, you can check your robots.txt file and ensure that it is not blocking any necessary paths. Here’s how you can edit your robots.txt file using Rank Math:

1. Go to Rank Math SEO → General Settings → Edit .robots.txt.
2. Ensure that the necessary rules are included and that nothing is blocking access to the llms.txt file.

If you need to regenerate your robots.txt file, you can use the default rules provided by Rank Math:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://rankmath.com/kb/indexed-though-blocked-by-robots-txt-error/

3. After making changes, save the file and check if the issue persists.

If you continue to experience difficulties, we recommend replying to this ticket so a human agent from our support team can assist you further.

Thank you for your patience, and we look forward to helping you resolve this issue!

Sources:
How to Fix the ‘Blocked Due to Other 4xx Issue’ Error » Rank Math
How to Fix the ‘Blocked Due to Other 4xx Issue’ Error » Rank Math

Hello,

Thank you for your query and we are so sorry about the trouble this must have caused.

Please ensure that you are using the latest version of Rank Math plugin. If not yet, please do update them. You may refer to our changelog page here: https://rankmath.com/changelog/

Please make sure that the llms.txt module is activated in Rank Math → Dashboard → Modules.

If the issue persists, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

Please do take a complete backup of your website before sharing the information with us.

It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

https://wordpress.org/plugins/temporary-login-without-password/

You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

https://wordpress.org/plugins/wp-security-audit-log/

We really look forward to helping you.

Hello,

Sure! Let us know how it goes.

Meanwhile, please don’t hesitate to let us know if you have any other questions.

Looking forward to helping you.

Thank you.