A problem with llms.txt file re-appeared?

#1121108
  • Resolved Danko Vujica

    1 month ago

    Rank Math free

    Hello,

    I already wrote here about an issue I am dealing with related to a 404 error of llms.txt file on my wesbite. Last time a member of your support shared a custom rule to be added to nginx.cfg file as a possible solution:

    location = /llms.txt {
    proxy_pass $dynamic_upstream_read_only;
    }

    I have a wesbite on a bluehost and last time when I got in touch with a support and shared what you advised, I was able to open the file, but after some time, when I tried to open it again, there was a 404 error once again. Now, a member of a bluehost support wrote following:

    “I’m sorry you’re encountering a 404 error with your llms.txt file, and we’re here to help you sort this out. Since RankMath support suggested adding a custom rule in your nginx configuration, but Bluehost typically uses Apache servers for shared hosting, direct nginx configuration changes might not be applicable.”

    I also checked on my cpanel and there is no llms.txt file in public_html folder and one support memeber from bluehost already checked a .htaccess file for any possible conflict lines in it. Also there is a license.txt file in public_html folder from wordpress but I would not say that that could be the conflict?

    Unfortunately nothing changed with a modified .htacces. They also told me that they can not do a lot if the file itself is not generated properly and located in cpanel.

Viewing 6 replies - 31 through 36 (of 36 total)
1 2 3
  • Jeremy

    1 week, 1 day ago

    Hello,

    We’ve checked and flushed the permalink settings from our end, and the llms.txt file is now accessible again. This indicates that the issue is likely caused by heavy caching, possibly at the server level.

    We recommend checking with your hosting provider to see if there’s any server-side caching system (such as NGINX cache, Varnish, or another caching layer) that may be restoring outdated configurations or cached files.

    Additionally, you can try adding the following code snippet to your site to automatically refresh the rewrite rules every hour:

    add_action('my_hourly_event', 'do_this_hourly');

function my_activation() {
    if ( !wp_next_scheduled( 'my_hourly_event' ) ) {
        wp_schedule_event(time(), 'hourly', 'my_hourly_event');
    }
}

add_action('wp', 'my_activation');

function do_this_hourly() {
    global $wp_rewrite;
    $wp_rewrite->flush_rules();
}

    You may refer to this guide on how to add filters to your website: https://rankmath.com/kb/wordpress-hooks-actions-filters/

    Please check with your hosting provider regarding the caching setup and let us know how it goes. We’ll be happy to assist further if the issue persists.

    Looking forward to helping you.

    Danko Vujica

    1 week, 1 day ago

    Rank Math free

    Ok. Thank you. I hope they will manage to fix the issue with the heavy caching as you said. I have also tested the other two plugins that generate automatic llms.txt file and it worked without any issue. I will share what you told me with my hosting provider and hopefully it will be possible to fix it. If no, then I will add manually the last version you shared here.
    I will provide the feedback here after I contact my provider.

    Best regards

    Danko Vujica

    1 week ago

    Rank Math free

    As you suggested, I reached out to the support of my hosting provider.They checked the server-side caching and empty the cache folder. I have also purged everything from the cloudflare page cache config section. Unfortunately the issue remained. Other similar plugins that I installed to test it, managed to generate the llms.txt file without any issue. Therefore, I added the content from the last generated version you shared here with me, and paste it to my manually created llms.txt file in the root.

    The support stuff from my hosting provider also told me that there is no issue from their side, and that if you will have any specific code snippet or rule to share, related to my site and wordpress settings, you can share with me and I will pass it to them so they can modify it accordingly.

    Thank you all for your effort and help and I do hope the issue will be fixed in the future.

    Best regards!

    Jeremy

    1 week ago

    Hello,

    The rule is simply to whitelist the path https://www.dankovujo.com/llms.txt. However since you mentioned that you tested this with other llms.txt plugins without any issues, this is something we need to check with our development team.

    If the issue persists with whitelisting the path via server-level, you may get back to us here and share both your WP admin login and FTP again in the Sensitive Data section of this ticket so we can deeply debug this.

    Looking forward to helping you with this one and thank you so much for your time and patience.

    Danko Vujica

    6 days, 7 hours ago

    Rank Math free

    Thank you, Jeremy. I appreciate your help. Since two similar plugins were able to generate a llms.txt file in the root, I will leave it as it is for now. After receiving your notice about the fix from your side, I managed to open the generated file twice and copy/paste the full content from it. After the issue reappeared, I have uploaded the file again to the root with the last generated content from rm.
    I will update the plugin regularly, and hopefully it will be fixed in the future.

    Best regards

    Jeremy

    6 days, 1 hour ago

    Hello,

    Thank you for the update, and we truly appreciate your patience throughout this process.

    It’s perfectly fine to keep the manually uploaded llms.txt file for now. We’ve noted this behaviour, and if there’s an improvement for this in a future release, we’ll let you know.

    We’ll close this ticket for now, but you’re always welcome to open a new one anytime you need assistance.

    Thank you.

Viewing 6 replies - 31 through 36 (of 36 total)
1 2 3

The ticket ‘A problem with llms.txt file re-appeared?’ is closed to new replies.