No Indexing Products in Hidden Product Categories

#525803
  • Hello

    Our website is http://www.chalmersgems.com

    We have an e-commerce website and we are struggling with the no-indexing of Products that are within HIDDEN product categories.

    For example, we already have this configuration in the RM Plug-in disallowing the indexing of the category and the (part) product name. It does not work.

    User-agent: *
    Disallow: /instagram-live/*
    Disallow: /facebook-live/*
    Disallow: /direct-invoices/*
    Disallow: /wp-admin/
    Disallow: /checkout/
    Disallow: /my-account/
    Disallow: /product/-fbl
    Disallow: /product/-ig
    Disallow: /product/-igl
    Disallow: /product/-di
    Disallow: /product/-fb
    Disallow: /product/-ill
    Disallow: /product/-dg
    Disallow: /add-to-cart=
    Disallow: /plugins/exit-popup/
    Allow: /wp-admin/admin-ajax.php

    The only thing that works to is if we MANUALLY change the product to No-Index within the advanced settings on EVERY product.

    We have HUNDREDS of products like this every week so we can’t do it manually.

    We can not set no-index at global level as we need other products to index.

    Can you help please?

    Many thanks
    Sheena

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    Please note that disallowing URLs in your robots.txt is different from setting them to noindex. Google can still get them indexed even if you have disallowed them in your robots.txt.

    In this case, you can use and customize this filter that can help set this programmatically: https://rankmath.com/kb/filters-hooks-api-developer/#change-robots-meta

    ​​​​​​Please note that the usage of this filter won’t change the data in the database as it will only run and override the robots meta settings when the page load.

    Hope that helps.

    Thank you.

    Hi

    We are trying a new method so have updated to RM Pro so we can use the CSV import BUT our shared server doesn’t have the capacity to run the report!!!

    We need the field ID’s in the CSV for e-commerce Product level indexing please. Can you let me have those?

    Many thanks
    Sheena

    Hello,

    When you export the CSV, the ID field should be included as well in the file

    ID

    If you’re unable to export the CSV, please check your site’s configuration if there are some PHP values that are too low and which you should increase. Please get in touch with your web host and ask them to set the following values:

    PHP Memory Limit: 512M
    Max input time: 150
    PHP time limit: 120
    PHP max input variables: 1000

    Hope that helps.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘No Indexing Products in Hidden Product Categories’ is closed to new replies.