Hello,
We apologize for the issue you are facing with the llms.txt file not being generated on your website. It sounds like you’ve taken the right steps by enabling the LLMS Txt module and saving your settings.
Here are a few things you can check to troubleshoot this issue:
-
Permalink Settings: Ensure that your permalink settings are configured correctly in WordPress. Sometimes, resetting permalinks can help resolve 404 errors. You can do this by going to Settings → Permalinks and simply clicking Save Changes without making any changes.
-
File Permissions: Check the file permissions on your server. The server needs to have the correct permissions to create and serve the llms.txt file. Ensure that the permissions for the root directory of your website allow for file creation.
-
Caching Issues: If you have any caching plugins or server-side caching enabled, try clearing the cache. Sometimes, cached versions of your site can cause issues with newly created files.
-
Conflict with Other Plugins: There might be a conflict with another plugin that is preventing the llms.txt file from being generated. You can try deactivating other plugins temporarily to see if that resolves the issue.
-
Theme Issues: Occasionally, themes can interfere with how files are served. Switching to a default WordPress theme (like Twenty Twenty-One) temporarily can help identify if this is the case.
If you’ve checked all of these and the issue persists, please reply to this ticket with any error messages you might see in your server logs or any additional details about your setup. A human agent from our support team will then take over and assist you further.
Thank you for raising this concern, and we look forward to helping you resolve it!
Sources:
How to Use llms.txt in Rank Math SEO » Rank Math
We followed all the debugging steps suggested in the automated response, but unfortunately the issue persists.
For your reference, the website is hosted on the WP Engine platform, which uses an NGINX server. Based on this, we suspect the issue may be related to NGINX configuration or server-level restrictions. We already tried reached WP Engine support, but they are unable to sort out the problem.
If you have any suggestions, known workarounds, or additional details that could help resolve this, please let us know.
Hello,
Thank you for your query and we are so sorry about the trouble this must have caused.
Please ask your host to flush the NGINX cache and exclude the caching for the responses made for the .txt files. Once done, our plugin should be able to generate the llms.txt file.
Some users who are also hosting with WP Engine claimed they got their llms.txt working by adding the following snippet to their config file:
location = /llms.txt {
proxy_pass $dynamic_upstream_read_only;
}
Let us know how that goes. Looking forward to helping you.
Hi Jeremy,
Thank you for your reply.
I contacted WP Engine support again today. They cleared the NGINX cache once more and re-added the snippet to the configuration. The file is now loading correctly.
Thank you for your support and time.
Thanks & Regards,
John
Hello,
We are super happy that this resolved your issue.
If you have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.