Hi Deepak,
Thanks for your query.
Please check your Google Search Console and see which pages are set to No Index.
If you notice that some of your pages aren’t appearing in Google even when they are set to index, there is nothing to worry about because something Google takes its time to crawl all your pages.
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Thanks for your response Todd.
My concern is not exactly that the pages are not appearing on Google. I am getting revenue from organic search on many pages where I see all the boxes are unchecked.
Which is why I assumed that by default the post is getting indexed. These old posts were written when I had Yoast.
But my concern is that why some of the pages are left out. I doubt that waiting will solve my problem because the recent pages are indexed as I saw on search console, it must be old pages which are left out but unfortunately I don’t know which one.
The most important question is “How can I validate which pages are not indexed?”
It is a long time taking process to go through the “Excluded” list in my search console under coverage.
Regards
Deepak
Hi Deepak,
Thanks for the follow up.
You can make use of the option shown below to check the pages that are set to no index on the post listings page:
I hope this info helps. Thank you.
Hi Deepak,
I wanted to add that there is no easy way to check which pages from your website are not yet indexed. I will leave you with this resource though if you want to get down to it:
https://searchengineland.com/check-urls-indexed-without-upsetting-google-follow-267472
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Hello team,
I still see the same problem
and there are no posts with are “non index”
So what could be the problem?
Why Rank Math claims only 82 pages are indexed. And I know the configuration is updated so the problem must be something else.
On google search console anyway to check these non indexed pages?
Hi there,
Thanks for the response.
I am afraid that Google does not provide a tool or data on whether a web page has been indexed or not, we must rely on narrowing down our list of URLs that may not be indexed.
From the resource page above, you can do this by examining your Analytics data for pages that are on our website but not receiving organic Google traffic, and by looking in server log files. From there, you can manually spot-check your shortened list of URLs.
It’s not an ideal solution, but it gets the job done. I hope that in the future, Google will provide a better means of assessing which pages have been indexed and which ones have not.
Your best option would be to wait for Google bots to crawl through the rest of the posts since they are already on the sitemap.
I hope this info helps. Thank you.
Hello Michael,
Thanks for your response.
But again the question remains why is Rank Math unable to put all my posts to index?
Why it indexed only 82 of my pages?
As I had also informed earlier, on my posts which were written with Yoast has all options unchecked. So is it possible that those are the one which are non-indexed?
Should I assume that all the posts written when RM was not installed, are not indexed?
Hi there,
Thanks for the follow up.
Rank Math will check the index option on your posts and pages and add them to the sitemap file for Google bots to crawl. It is upto Google to honor the request and thus outside the control of the plugin.
If you are worried that your older posts are set to noindex I will be happy to lend a hand and check. Please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
We really look forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
> But again the question remains why is Rank Math unable to put all my posts to index?
> Why it indexed only 82 of my pages?
This is not from Rank Math. That information is pulled from your Search Console. As per Google, the submitted URLs via Sitemap are 102. But Google has indexed (for whatever reason) 82 of those submitted URLs. This will not change even if you decide to turn off the SEO plugin or switch to any other SEO plugin.
This is just what Google did and no plugin has any impact on that. Google might not deem some of your posts worthy of indexing or there could be any number of reasons.
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Hello Todd,
Thanks for your response.
Ok, I have one example case. I was going through the “Excluded” section in “Alternate page with proper canonical tag”
and there I have one post which is excluded
https://www.golinuxcloud.com/openstack-installation-packstack-centos-linux-7
It was crawled on May 11 which I had manually submitted.
Now this post was created on Yoast. Later I edited this post and changed the URL and created a redirection.
Old link => https://www.golinuxcloud.com/install-openstack-using-packstack/
I see even the sitemap is still showing the old url
Can this be the cause of getting this URL as excluded? How can I bring it back to indexed page?
HI there,
Thanks for the response.
Yes this could be the cause, how did you setup the redirect? Does it still exist?
If not, you can create some new redirects for these posts so that Google can hop over and index the new pages.
I hope this info helps. Thank you.
Hello team,
You can check both the links, the redirect works just fine.
It was done using rank Math plugin.
I had also submitted for re-indexing manually to google as it shows for 11 may 2019 but yet this is in the excluded list
and also why sitemap still shows the old url? Will it not update itself? anyway to refresh the sitemap?
Hello,
The sitemap is refreshed automatically.
If you have any website cache, please clear that to see the changes take effect.
Upon checking further, it appears the page you mentioned is already indexed:
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
