URL’s with /feed/ crawled by Google

#128196
  • Hi, how are you? How can i avoid Google to Crawl URL’s with feeds on my websites?

    Example(Not my real web):

    http://www.juanito/viajes/italia/feed/, this i the kind of URL Google is crawling but still not indexed, i think.

    Do you think adding this code would be enough?

    remove_action( ‘wp_head’, ‘feed_links’, 2 );
    remove_action(‘wp_head’, ‘feed_links_extra’, 3 );

    I am not very sure if i should touch something on RankMath or with this code is ok.

    Thanks a lot for your answer.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention.

    You can avoid Google crawling your pages/posts by simply setting them to noindex in Rank Math advanced settings:
    Noindex

    However, you cannot noindex feeds, but you can disallow them in your robots.txt file at WordPress Dashboard > Rank Math > General Settings > Edit Robots.txt like this

    User-Agent: *
    Disallow: */feed/

    I hope that helps. Thank you, and please don’t hesitate to contact us if you need further assistance.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    Those are your search results and those are suitable to be noindexed. You can change the settings from WordPress Dashboard > Rank Math > Titles & Meta > Misc. Pages.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this ticket.