URL’s with /feed/ crawled by Google

#128196
  • Resolved Gustavo Henríquez
    Rank Math free

    Hi, how are you? How can i avoid Google to Crawl URL’s with feeds on my websites?

    Example(Not my real web):

    http://www.juanito/viajes/italia/feed/, this i the kind of URL Google is crawling but still not indexed, i think.

    Do you think adding this code would be enough?

    remove_action( ‘wp_head’, ‘feed_links’, 2 );
    remove_action(‘wp_head’, ‘feed_links_extra’, 3 );

    I am not very sure if i should touch something on RankMath or with this code is ok.

    Thanks a lot for your answer.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention.

    You can avoid Google crawling your pages/posts by simply setting them to noindex in Rank Math advanced settings:
    Noindex

    However, you cannot noindex feeds, but you can disallow them in your robots.txt file at WordPress Dashboard > Rank Math > General Settings > Edit Robots.txt like this

    User-Agent: *
    Disallow: */feed/

    I hope that helps. Thank you, and please don’t hesitate to contact us if you need further assistance.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    Those are your search results and those are suitable to be noindexed. You can change the settings from WordPress Dashboard > Rank Math > Titles & Meta > Misc. Pages.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘URL’s with /feed/ crawled by Google’ is closed to new replies.