Remove certain URL from my website

#439298
  • Resolved Dr Gunther Heller Ortodontia Digital Invisalign ClearCorrect

    1 year, 8 months ago

    Rank Math free

    Please I am trying to remove this URL from my sitemap using robot.txt since I couldn’t do it using Rank Math plugin. Am I right?

    User-agent: *
    Disallow: /comments/feed
    Disallow: /contato-invisalign-clearcorrect/feed
    Disallow: /index.php/alinhador-transparente
    Disallow: /index.php/ortodontista-no-menino-deus
    Disallow: /tag/ortodontista-bairro-menino-deus
    Disallow: /invisalign-ortodontista-porto-alegre/@drguntherheller
    Disallow: /tag/ortodontista-de-aparelho-invisivel
    Disallow: /index.php/home-2
    Disallow: /author/dr-guntherheller
    Disallow: /tag/clinica-gunther
    Disallow: /clearcorrect-invisalign-aligner-smilink-sousmile-clear-aligner-clic-alinhadores
    Disallow: /tag/dentista/feed
    Disallow: /invisalign-e-clearcorrect-para-esportistas-eu-posso-usar-invisalign-ou-clearcorrect-enquanto-pratico-esportes-by-clinica-dr-gunther-heller-ortodontia-digital-no-bairro-menino-deus-em-porto-alegre/@drguntherheller
    Disallow: /tag/invisaligninvisalign

Viewing 1 replies (of 1 total)
  • Reinelle

    1 year, 8 months ago

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention.

    Disallowing those URLs in your robots.txt may still show the URLs in search engines.

    If search engines cannot crawl the content, then they cannot see the NOINDEX meta tag and therefore cannot exclude the content from search results.

    Could you please share the sitemap URL so we can check as well? If they are non-existing URLs on your site, they should be removed in real-time.

    For initial troubleshooting, please make sure that your sitemap is not getting cached. Please follow these steps:

    1. Ensure you’re using the latest version of your plugins/theme including the Rank Math plugin.

    2. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/xXXhDt

    3. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server:
    https://rankmath.com/kb/exclude-sitemaps-from-caching/

    Let us know how this goes.

    Thank you.

    RankBot

    1 year, 7 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘Remove certain URL from my website’ is closed to new replies.