https://rankmath.com/kb/indexed-though-blocked-by-robots-txt-error/

#948450
  • Resolved Relentless Roaming
    Rank Math free

    I am having a BIG issue with pages not appearing on google. (I have gone through the Rank Math article)

    https://technicalseo.com/tools/robots-txt/
    I have checked this and have since reset the robots-txt file through Rank Math plugin and requested the validate fix through google search console.

    Can you please advise if there is something else I need to do to fix this?

    There were some pages which I wanted to block from google but not the ones which now have this block in place!

Viewing 2 replies - 1 through 2 (of 2 total)
  • Hello,

    We apologize for the issue you are facing with your pages not appearing on Google. It sounds like you’ve already taken some important steps by checking your robots.txt file and resetting it through the Rank Math plugin, as well as requesting a validation fix in Google Search Console.

    Here are a few additional steps you can take to resolve the issue:

    1. Review Your Robots.txt File: Ensure that the directives in your robots.txt file are correctly set up. You want to make sure that the pages you want indexed are not being blocked. You can access your robots.txt file directly at yourdomain.com/robots.txt to verify its content.

    2. Check for Noindex Tags: If you have added any noindex tags to the pages you want indexed, remove them. The noindex tag prevents pages from being indexed by search engines.

    3. Use Google Search Console: After making changes, go back to Google Search Console and use the URL Inspection Tool to check the status of the affected URLs. This tool will show you if the page is blocked and provide insights into any issues.

    4. Validate Fix Again: After making adjustments, click the Validate Fix button again in Google Search Console to prompt Google to re-crawl the URLs.

    5. External Links: If there are external links pointing to the blocked pages, consider reaching out to those sites to update their links if necessary.

    6. Content Quality: Ensure that the content on the pages you want indexed is high-quality and relevant, as this can also affect indexing.

    If you continue to experience issues after these steps, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.

    Thank you for raising this concern, and we hope this helps resolve your issue!

    Hello,

    Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

    You can use any image-sharing tool like https://imgur.com/ to upload the screenshot and share the link here so that we can check this further for you.

    However, we checked your website and we can see the default robots.txt rules are added there. In this case, please share some affected URLs also so that we can check them as well.

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 2 replies - 1 through 2 (of 2 total)

The ticket ‘https://rankmath.com/kb/indexed-though-blocked-by-robots-txt-error/’ is closed to new replies.