About Robots.txt

Hello,

I apologize for the issue you’re facing with the “Alternate page with proper canonical tag” and “crawled – currently not indexed” pages in Google Search Console.

To deindex these pages, you can add specific rules to your robots.txt file. However, it’s important to note that the robots.txt file is primarily used for controlling crawling, not indexing. To prevent pages from being indexed, it’s recommended to use the appropriate meta tags or directives.

For the “Alternate page with proper canonical tag” pages with the “/amp” extension, you can add the following rule to your robots.txt file:

User-agent: *
Disallow: /*/amp$

This rule will disallow crawling of any URLs that end with “/amp”.

As for the “crawled – currently not indexed” pages with the “/feed” extension, it’s important to understand that blocking access to feed pages is not recommended by Google. However, if you still want to prevent search engine crawlers from accessing or crawling these pages, you can add the following rule to your robots.txt file:

User-agent: *
Disallow: */feed/

Please note that modifying the robots.txt file should be done with caution, as incorrect rules can have unintended consequences. It’s always a good idea to keep a backup of your existing robots.txt file before making any changes.

To edit your robots.txt file using Rank Math, you can go to Rank Math SEO → General Settings → Edit robots.txt in your WordPress admin area. If you don’t see this option, please ensure that you are using the Advanced Mode in Rank Math.

I hope this helps! If you have any further questions or need assistance, please feel free to ask.

Thank you.

Sources:
Alternate Page with Proper Canonical Tag Status in Google Search Console » Rank Math
How to Fix the “Indexed, though blocked by robots.txt” Error » Rank Math
Rank Math Sitemap Issues and Their Fixes » Rank Math
What Are the Best Robots.txt File Rules for Multisite? » Rank Math