URL’s with /feed/ crawled by Google

#128196
  • Gustavo Henríquez

    2 weeks, 1 day ago

    free

    Hi, how are you? How can i avoid Google to Crawl URL’s with feeds on my websites?

    Example(Not my real web):

    http://www.juanito/viajes/italia/feed/, this i the kind of URL Google is crawling but still not indexed, i think.

    Do you think adding this code would be enough?

    remove_action( ‘wp_head’, ‘feed_links’, 2 );
    remove_action(‘wp_head’, ‘feed_links_extra’, 3 );

    I am not very sure if i should touch something on RankMath or with this code is ok.

    Thanks a lot for your answer.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Reinelle

    2 weeks ago

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention.

    You can avoid Google crawling your pages/posts by simply setting them to noindex in Rank Math advanced settings:
    Noindex

    However, you cannot noindex feeds, but you can disallow them in your robots.txt file at WordPress Dashboard > Rank Math > General Settings > Edit Robots.txt like this

    User-Agent: *
Disallow: */feed/

    I hope that helps. Thank you, and please don’t hesitate to contact us if you need further assistance.

    Gustavo Henríquez

    1 week, 6 days ago

    free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Uzair

    1 week, 6 days ago

    Hello,

    Those are your search results and those are suitable to be noindexed. You can change the settings from WordPress Dashboard > Rank Math > Titles & Meta > Misc. Pages.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this ticket.