Edit robots.txt file

#65782
  • Resolved Michael Tsironis

    3 years, 9 months ago

    Rank Math pro

    Hi,
    i am setting up Rank Math migrating from Yoast and i am in the edit robots.txt section. The import process (from Yoast) imported the following data:

    Sitemap: https://mysite/sitemap.xml (Wherever “mysite” is my actual site name)

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Disallow: /wp-includes/

    I am concerned about the Disallow: /wp-includes/ written above. Would be better not being there at all or to be Allow: /wp-includes/ ? I guess i want to be indexed by Google bots for all the images and related stuff for my eshop. Correct?

    Also below the field where i can edit the above script there a line saying the following:
    “Contents are locked because robots.txt file is present in the root folder.” Is this something i must consider?

    Can you advise me what to do? Is there a better script to throw inside robots.txt setup…?

    Thank you
    Michael

Viewing 3 replies - 1 through 3 (of 3 total)
  • Uzair

    3 years, 9 months ago

    Hi Michael,

    Thanks for getting in touch with us.

    This is the default robots.txt file we create:

    # This file is automatically added by Rank Math SEO plugin to help a website index better
# More info: https://rankmath.com/wordpress/plugin/seo-suite/
User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://rankmath.com/sitemap_index.xml

    You can replace your domain name and use this one as well.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Michael Tsironis

    3 years, 9 months ago

    Rank Math pro

    Uzair hi,

    many thanks for your reply.

    Regards
    Michael

    Alberto

    3 years, 9 months ago

    Rank Math business

    Hello Michael,

    We are super happy that this resolved your issue. If you have any other questions in the future, know that we are here to help you.

    If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.

    If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this ticket.