A problem with llms.txt file re-appeared?

#1121108
  • Resolved Danko Vujica
    Rank Math free

    Hello,

    I already wrote here about an issue I am dealing with related to a 404 error of llms.txt file on my wesbite. Last time a member of your support shared a custom rule to be added to nginx.cfg file as a possible solution:

    location = /llms.txt {
    proxy_pass $dynamic_upstream_read_only;
    }

    I have a wesbite on a bluehost and last time when I got in touch with a support and shared what you advised, I was able to open the file, but after some time, when I tried to open it again, there was a 404 error once again. Now, a member of a bluehost support wrote following:

    “I’m sorry you’re encountering a 404 error with your llms.txt file, and we’re here to help you sort this out. Since RankMath support suggested adding a custom rule in your nginx configuration, but Bluehost typically uses Apache servers for shared hosting, direct nginx configuration changes might not be applicable.”

    I also checked on my cpanel and there is no llms.txt file in public_html folder and one support memeber from bluehost already checked a .htaccess file for any possible conflict lines in it. Also there is a license.txt file in public_html folder from wordpress but I would not say that that could be the conflict?

    Unfortunately nothing changed with a modified .htacces. They also told me that they can not do a lot if the file itself is not generated properly and located in cpanel.

Viewing 15 replies - 16 through 30 (of 36 total)
  • Greetings to all,

    I would like to kindly inquire if the RankMath support team can inspect my files today regarding the issue with the llms.txt file. I would appreciate it if you could check this today so we can finally close the ticket.
    Additionally, could you please confirm whether you can log in using the data I provided?

    Thank you!

    For the record, we host our WP sites at Kinsta. In order to make the llms.txt file not 404, we had to set the following NGINX directive:

    location = /llms.txt {
    try_files $uri $uri/ /index.php?$args;
    }

    The previous NGINX rule that another RankMath support thread wasn’t working. Kinsta had to replace it with try_files to allow the file to be served directly from the server instead of routing it through the dynamic upstream. This approach should be more efficient and prevents potential access or routing issues for static files like /llms.txt.

    Hello,

    Thank you for sharing your insights. I run my website on Bluehost, which uses Apache as its web server. I have successfully created a manual file with the necessary content, and it works perfectly for me. However, I’ve encountered an issue when attempting to use plugins to generate the file. This problem is not limited to the RM plugin; I have experienced similar issues with another plugin as well.

    I plan to reach out to Bluehost support for assistance and will ask them to look into the issue again. It has already taken up too much of my time, so for now, I will leave things as they are.

    I appreciate everyone who tried to help me, and I hope the guidelines you shared will assist others who may face the same issue on their websites.

    Thank you!

    Hello,

    Although creating the file manually works well, it may be hard to manage since this requires constant updating of the file if you have new content to add.

    If you want us to check further, please include a working WP admin and FTP login in the Sensitive Data section of this ticket.

    Danko Vujica
    Rank Math free

    Hello,

    I have already shared my login information for 24 hours on two occasions, but I understand you may have been busy. Thank you for all your responses, regardless.

    Unfortunately, the issue with the automatic creation of llms.txt is not limited to the RM plugin; I also installed another relevant one that generates both llms.txt and llms-full.txt automatically, and it experienced the same problem.

    I will be seeking support from my hosting provider. Jeremy, if you have any potential solutions, please feel free to share them here in this ticket, and I will forward them to my hosting provider.

    For the time being, managing the file manually will suffice. I will update this ticket with any solutions provided by my hosting provider.

    Best regards

    Ava Taylor
    Rank Math free

    That’s a perfect, concise and clear reply — it directly solves the issue and guides step-by-step. You can post it as-is in the forum; it’s short, accurate, and easy to follow.

    Hello,

    Thank you for the update.

    Since the issue affects multiple plugins, it does appear to be hosting-related. Please make sure your hosting allows the llms.txt file to be publicly accessible and not blocked, as that could be the cause of the problem.

    We’ll go ahead and close this ticket for now, but if the issue arises again, please feel free to create a new support ticket and we’ll be happy to assist you further.

    Hello,

    I was told from the Bluehost support team that the issue has nothing to do with their backend and that I should ask for a solution again here on the RM ticket. Therefore, I would like to try again to solve my problem with llms.txt with your assistance. In the “Sensitive Data” area are my updated login data as you requested. Could you please inspect my files and try to fix this unusual bug. Looking forward to your feedback. There is also an issue with the api key from your index plugin which I also had to manually add, and it is located in the root in cpanel. Hope you will be able to fix that as well.

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    We would like to check this with our development team but the FTP login you shared is not working. Can you please verify that?

    We tried both regular FTP and SFTP but we couldn’t connect to your server.

    Looking forward to helping you with this one.

    Hello,

    Sorry for that. I have just changed the password and added it to the sensitive data. Additionally, I have also tested the login through a Filezilla and I was able to login. Can you please check now? Hope it will work for you now. The port I used was 21.

    Thank you.

    Hello,

    Sorry, but we still can’t access your FTP. We tried using your website’s IP and the domain you provided in the Sensitive Data section and we still couldn’t get through. See screenshot below:

    Rank Math support

    Can you please share the correct FTP login using the following format?

    Host: 
    Username:
    Password:
    Port:

    Looking forward to helping you with this one.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello Jeremy,

    Just to check if you were able to login with the new data I added?

    Now, I have added additional FTP account that I created along with the old one for which I shared the new password. I would appreciate your feedback. I am able to login with the both FTP accounts via Filezilla by using the port 21 and login data which are available for you in the “Sensitive Data” area.

    Hello,

    Thank you. We have fixed the llms.txt file on your website and the file is now generated by Rank Math:

    Rank Math support

    Hope that helps.

    Hello,

    I have just tried to open the file and once again I have 404? I tried to resave the permalink settings but the issue remains. Also, I celared the browser and the site cache but still no luck.
    Also the file is not present in cpanel? llms.txt screenshot

    Could you please check once again because from my side it is all the same unfortunately. I appreciate your help.

    Thanks!

Viewing 15 replies - 16 through 30 (of 36 total)

The ticket ‘A problem with llms.txt file re-appeared?’ is closed to new replies.