Editing robots

#267603
  • Resolved Briany Hearne

    3 years, 3 months ago

    Rank Math free

    Hi Guys,

    In an earlier ticket you helped me to understand that by adding Disallow: /*?* to my robots.txt I would stop Google from indexing URLs with any parameters.

    So far so good except that now my total robots.txt file is this…

    https://www.kamperfan.ie/robots.txt

    That can’t be right can it?

Viewing 3 replies - 1 through 3 (of 3 total)
  • Prabhat

    3 years, 3 months ago

    Rank Math agency

    Hello,

    Thank you for contacting us.

    The robots.txt is not configured correctly. Please replace the content of the robots.txt with the below rules to fix this:

    User-agent: *
Disallow: /wp-admin/
Disallow: /*?*
Allow: /wp-admin/admin-ajax.php
Sitemap: https://www.kamperfan.ie/sitemap_index.xml

    The above rules contain the default rules along with blocking the URLs with parameters.

    Hope this helps.

    Thank you.

    Briany Hearne

    3 years, 3 months ago

    Rank Math free

    Ok, got it…. thanks 🙂

    Prabhat

    3 years, 3 months ago

    Rank Math agency

    Hello,

    We’re glad that we could address the concern.

    If you have another question in the future, please feel free to reach out, and it will be our pleasure to assist you again.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘Editing robots’ is closed to new replies.