Robots.txt not working

#160814
  • Resolved James Cantwell
    Rank Math free

    All pages are currently being disallowed which is not what I want. Correct me if I’m wrong, but Rank SEO is supposed to create a virtual robots.txt file for me, yes? I have removed the empty robots.txt file that was preventing editing from the plugin, and have ensure that the site is allowed to be index (crawled) in the setting -> reading setting. Please advise. Thanks.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Anas
    Rank Math business

    Hello,

    Thank you for contacting Rank Math, and sorry for any inconvenience caused.

    Please ensure that there are no server restrictions on that file by contacting your hosting provider first and asking them to check that.

    If that doesn’t help, please share your WordPress admin and FTP access in the sensitive data section.

    If you are able to edit the robots.txt, the content should look similar to this:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://yourdomain.com/sitemap_index.xml

    I hope this helps. Looking forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Anas
    Rank Math business

    Hello,

    I have logged in to your site and was able to edit the robots.txt from Rank Math > General Settings.

    I have updated your robots.txt
    settings

    Result:
    result

    I hope this helps. Looking forward to helping you.

    Thanks you very much!

    Anas
    Rank Math business

    Hello,

    We are super happy that your issue is resolved. If you have any other questions in the future, know that we are here to help you.

    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.

    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Robots.txt not working’ is closed to new replies.