No Follow in Robots.txt

#871796
  • Resolved Mike McDonnell
    Rank Math free

    Hi guys!

    I’ve run into an issue on samleisure.co.uk, where they pay for RankMath Pro and was wondering if you’ve experienced something similar before and/or found a fix?

    The site uses WooCommerce and Elementor and some of the product category pages are being flagged as non-indexable in Screaming Frog due to a noindex tag.

    However, when I check these categories in RankMath, they’re set to index as shown in the imgur screenshot.

    No-index is appearing in the code on inspection, so I’ve also checked the robots.txt file, and there’s nothing disallowing the categories (also shown).

    Cheers in advance if you can help!

    https://imgur.com/a/9IHrIx8

Viewing 10 replies - 1 through 10 (of 10 total)
  • Hello,

    We apologize for the issue you are facing with the noindex tag on your product category pages. Thank you for providing the details and the screenshot link.

    It seems like there might be a few reasons why the noindex tag is appearing despite your settings in Rank Math. Here are some steps you can take to troubleshoot this issue:

    1. Check for Plugin Conflicts: Sometimes, other plugins can interfere with the settings of Rank Math. You can use the Health Check plugin to identify any potential conflicts.

    2. Inspect the Page Settings: Ensure that the specific product category pages do not have individual settings overriding the global settings in Rank Math. You can check this by editing each category and looking at the Rank Math SEO settings.

    3. Review Custom Code: If there is any custom code added to your theme or through a plugin that might be affecting the output of the meta tags, it could lead to a noindex being applied.

    4. Clear Cache: If you are using any caching plugins, clear the cache to ensure that you are viewing the most recent version of your pages.

    5. Check Robots.txt: Although you mentioned that there’s nothing disallowing the categories in your robots.txt file, it’s good to double-check using the Robots Testing Tool to ensure that Googlebot is not being blocked from crawling these URLs.

    6. Use the Index Status Report: Since you have Rank Math Pro, you can navigate to Rank Math SEO → Analytics → Index Status to see if there are any issues reported for those specific categories.

    If after checking these points the issue persists, please reply to this ticket, and a human agent from our support team will assist you further.

    Cheers!

    Sources:
    How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math

    Thank you, but none of the above has worked.

    Just to let you know, the Index Status Report doesn’t show this or the other category pages as set to noindex.

    Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    Can you confirm if these categories have any posts yet?

    In this case, please head over to your WordPress Dashboard > Rank Math > Titles & Meta > Global Meta, and from there disable the Noindex Empty Category and Tag Archives option:

    Hope that helps and please don’t hesitate to let us know if you have any other questions.
     
    Thank you.

    Thanks for your reply, I’ve switched that off. It’s actually a product category, not posts and as you can see it’s not empty either:

    https://samleisure.co.uk/product-category/table-football/

    Still having the same issue and can’t get it indexed on Google because of it.

    Hope you can help.
    Mike

    Hello,

    In this case, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.

    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    We’ve got the logins for your site, however, the issue is already fixed as it is now showing as index in the source code. Did you make any changes?

    Also, it seems that you’re using Rank Math PRO but the account you have used to open this ticket is the Rank Math free version.

    Can you please search and forward a receipt from FastSpring.com or the email address you used to purchase so we can locate your account and verify it?

    Looking forward to helping you.

    Amazing!!! We just purged the cache and it’s fixed.

    With the licensing, I’m just the client’s SEO, their web dev Leon Coppola would be able to help with the above. I work for Glide Marketing so don’t cover their subscription cost.

    Thank you!!!

    Hello,

    We’re delighted to hear that this issue has been resolved. We appreciate your feedback.

    This ticket will be closed now, but if you ever have another question or need any help in the future, please don’t hesitate to create a new forum topic. We’ll be more than happy to assist you again.

    Thank you for choosing Rank Math and have a wonderful day!

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘No Follow in Robots.txt’ is closed to new replies.