Hello,
Thank you for getting in touch and I am extremely sorry about the trouble this might have caused.
There are a few things you must check for in order to see why the posts aren’t getting indexed.
1. Make sure the post is not selected as ‘noindex’ in WP > Posts > Your Post > Advanced Tab in Rank Math.
Screenshot:
2. Ensure that the noindex is not selected for Global or Posts meta:
3. Check the sitemap settings and check if the posts are setup to be included in the sitemaps:
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Thanks for the help Anas. Unfortunately I’ve already checked all these areas and they all say Index as they usually do. And the sitemap does say include in sitemap.
By the way, my posts are being indexed, but my pages aren’t
Hello,
Thank you for keeping in touch with us.
Can you please share your affected URLs with us so we can check them on our end? You may insert this information in the Sensitive Data section.
We look forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
I checked the URLs and they seem to be set to index and even included in the sitemap.
In this case, you may choose to wait for Google to crawl and update this for these pages or optionally remove previously submitted sitemap and resubmit only the main sitemap(sitemap_index.xml) to make Google recrawl your site.
Hope this helps you.
Google tells me this in search console though
You submitted this page for indexing, but the page has a ‘noindex’ directive either in a meta tag or HTTP header. If you want this page to be indexed, you must remove the tag or HTTP header.
So you’re saying I don’t need to change anything, just resubmit the sitemap?
Hello,
It seems that Google is not recognizing your pages when they last crawled. I checked your home page URL and it was last crawled on January 23rd. See screenshot in Sensitive Data section.
Try to clear all your sitemap(s) from your Google Search Console and re-submit the main sitemap as mentioned by my colleague (yes, do not change anything since your pages are already set to index). Give it a couple of days for Google to re-crawl and see if the issue goes away.
We are looking forward to helping you.
Ok I’ll try that now and let you know if it is fixed. Thanks for the help!
Hello,
Thank you, let us know how it goes. We will keep this ticket open for you.
Looking forward to helping you.
Well I resubmitted my post and page sitemaps and the error is still being reported..
Hello,
Thank you for keeping in touch with us.
Upon checking your links once again, it looks like Google can’t reach your page because your website’s robots.txt has possibly blocked it. Please see the screenshot in the sensitive data section.
I also checked your robots.txt file and it seems to be just an empty file. Can you please check your root folder and see if you have an existing robots.txt file? If it does, please delete it and add this code instead in WordPress Dashboard > Rank Math > General Settings > Edit robots.txt.
User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://YOURWEBSITE.COM/sitemap_index.xml
After that, try to let Google recrawl your website once again.
Let us know how it goes.
Thanks, I’ve deleted my robots.txt file and updated it in the Rank Math plugin. Will let you know if we’ve fixed it
Hello,
Sounds good, We’ll keep this ticket open for you until we hear back from you.
In meantime, let us know if you need help with anything else.
Thank you.
Hello
It appears that this has not fixed the error either. But I can’t tell, search console is not updating past January 29th..
Hello,
All that is usually needed for Google to crawl your site is the sitemap. Since it seems these URLs aren’t updating, would you please try URL inspection for some of the URLs with an issue to see if it still persists.
Here is a Google article for reference: https://developers.google.com/search/docs/advanced/crawling/ask-google-to-recrawl
Looking forward to helping you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
