Greenwood Projects Indexing

#1051676
  • Resolved Mark Eustace
    Rank Math free
    Content AI Expert

    My site is not being indexed correctly and is reporting as being blocked by robots.txt – there is no file on my server and also the page source is reporting noindex under Rank Math – I really need help resolving this issue please

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    I apologize for the issue you are facing with your site’s indexing. It sounds like there may be a conflict between your robots.txt settings and the noindex directive in Rank Math.

    Here are some steps you can take to resolve the issue:

    1. Check for a robots.txt file: Even if you believe there is no file on your server, it’s worth checking by visiting yourdomain.com/robots.txt in your browser. If it exists, review its content for any Disallow directives that might be blocking Google from crawling your site.

    2. Edit your robots.txt file using Rank Math: If you find that there is a robots.txt file and it contains blocking directives, you can edit it through Rank Math. Go to Rank Math SEO → General Settings → Edit robots.txt in your WordPress admin area. Make sure to remove or adjust any directives that are preventing indexing.
      Edit robots.txt

    3. Review the noindex directive: Since you mentioned that the page source is reporting a noindex directive, ensure that this is intentional. If you want the page to be indexed, you will need to remove the noindex setting in Rank Math. You can do this by editing the page in WordPress and checking the Rank Math meta box settings.

    4. Request indexing in Google Search Console: After making these changes, go to Google Search Console and request indexing for the affected pages to prompt Google to recrawl them.
      Request Indexing

    If you’re still having trouble after following these steps, we recommend replying to this ticket with your site URL so that a human agent from our support team can assist you further. Thank you for raising this concern, and we’re here to help you resolve it!

    Sources:
    How to Fix Indexing Issues in Google Search Console » Rank Math
    How to Fix the "Indexed, though blocked by robots.txt" Error » Rank Math
    How to Fix ‘Page Indexed Without Content’ Issue in Google Search Console » Rank Math

    Mark Eustace
    Rank Math free
    Content AI Expert

    This is what came by from the URL search:

    User-agent: *
    Disallow: /

    Mark Eustace
    Rank Math free
    Content AI Expert

    hello?

    Mark Eustace
    Rank Math free
    Content AI Expert

    Is anyone there???

    Hello,

    Thank you for your query and we are so sorry about the trouble this must have caused.

    We checked your website and there seems to be no issue with both the robots meta and the robots.txt:

    Rank Math support

    Rank Math support

    Lastly, we checked your website on the SERP and we can confirm that a significant number of pages on your website are currently indexed:

    Rank Math support

    Please go to your GSC reports and validate the fix and if the issue persists, please share a full screenshot of the report along with the affected URLs here so we can take a closer look at it.

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Greenwood Projects Indexing’ is closed to new replies.