-
I have many /feed urls that has been crawled by google
How do I no index them.
I can’t find “feed” in my setting.
-
Hello,
I apologize for the issue you are facing with the /feed URLs being crawled by Google. To properly set your /feed URLs to noindex, you can follow these steps:
-
Edit the Robots Meta for the Feed URLs: You can manually set the noindex meta tag for your feed URLs using the Rank Math plugin. Here’s how to do it:
- Open your WordPress dashboard and navigate to the post or page that corresponds to the feed URL.
- In the Rank Math Metabox (found below the post editor), go to the Advanced Tab.
- Look for the Robots Meta settings and select No Index.
- Update the post/page to save your changes.
-
Using Robots.txt: If you want to block all feed URLs from being crawled, you can also add a rule in your robots.txt file. Here’s how:
- Go to WordPress Dashboard → Rank Math SEO → General Settings → Edit Robots.txt.
- Add the following line to disallow crawling of feed URLs:
Disallow: /feed/
- Save your changes.
-
Check Global Settings: Ensure that there are no global settings overriding your individual settings. Go to WordPress Dashboard → Rank Math SEO → Titles & Meta and check if there are any settings related to feeds that might be affecting their indexing status.
-
Resubmit Your Sitemap: After making these changes, it’s a good idea to resubmit your sitemap in Google Search Console to ensure that Google recognizes the updated settings. You can find instructions on how to do this here.
If you have many feed URLs and need a more comprehensive solution, consider using the bulk actions feature in Rank Math (available with PRO) to set multiple posts/pages to noindex at once.
If you need further assistance or if this does not resolve your issue, please reply to this ticket, and a human agent from our support team will assist you further. Thank you for raising this concern!
Sources:
How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math
Why Google Hasn’t Indexed Your Post, Page, and/or Website? » Rank MathHello,
Feed URLs are only the basic code versions of your actual content pages and are generated by WordPress. You will not want these pages to be indexed as Google doesn’t like them and would most likely not show them to users anyway.
You can add a
noindex x-robots-tag
to your feed headers instead. Adding the following code to the bottom of your server .htaccess file should work:<IfModule mod_headers.c> <If "%{THE_REQUEST} =~ m#/feed/?#"> Header set X-Robots-Tag "noindex" </If> </IfModule>
Please do take a complete backup of your website before modifying your .htaccess as it is a sensitive file.
Alternatively, if you want to completely disable them on your site, you can follow this guide:
https://rankmath.com/kb/disable-rss-feeds/Looking forward to helping you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
-
The ticket ‘how do I noindex /feed properly’ is closed to new replies.