Hello,
Thank you for contacting Rank Math, and sorry for any inconvenience caused.
The Crawled —currently not indexed report indicates that the content is eligible to appear in Google’s index, but Google is electing not to include it.
https://rankmath.com/kb/crawled-currently-not-indexed/
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
I have already read it, my content is 100 % unique and follow all the guidelines, but still they are not getting indexed.
Hello,
Please note that crawling and indexing of the website depend on the authority and crawl budget of the website.
It is completely upto Google if they want to index or not index your website. So, if you haven’t willingly or accidentally made your posts noindex and Google still isn’t indexing your posts – it means that Google doesn’t want to index your posts.
Please check this website for more details.
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Please check my website and let me know, if there is anything that I can improve. It would be very helpful for me.
Thanks
Hello,
I checked your website, it is correctly set to index.
The sitemap and robots.txt are also working fine.
Please make sure that you have submitted the sitemap in the Search Console:
https://rankmath.com/kb/submit-sitemap-to-google/
Hope that helps.
Thank you.
My Sitemap is also submitted in Search Console. Since 16 January I am facing this issue. I am unable to find the solution 🙁
Hello,
I checked the variations of your website using https://httpstatus.io/ and the HTTP + WWW variation is having a double 301 redirection. You can have a look at the screenshot below to understand this further.
Please ensure that only a single 301 redirection is applied to the non-preferred variations. Except for the preferred variation (which should return only a 200 status), all the non-preferred variations of the website should redirect to the preferred variation and return only a single 301 with a 200 status.
You can also get in touch with your web host regarding this.
Once this is fixed, please follow the below steps and see if that helps:
1. Flush the Sitemap cache by following this video screencast:
https://i.rankmath.com/pipRDp
2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
https://rankmath.com/kb/exclude-sitemaps-from-caching/
3. Clear your website’s cache and remove all the sitemaps from your Google Search Console account, and then submit only the main sitemap: /sitemap_index.xml.
Further, give Google some time to crawl your website again and see if more posts are indexed.
You can also have a look at this article to further understand the Crawled — Currently Not Indexed status – https://moz.com/blog/crawled-currently-not-indexed-coverage-status
Hope this helps.
Looking forward to helping you.
Thank you.
My web hosting provider suggested me, this additional redirect won’t cause any actual issues with your website, nor with your website’s ranking or whatsoever. Crawlers, like Google Bot do follow redirects and the important thing is that the end URL is always the same:
https://downloadandenjoy.com
This is what is really important to avoid duplicate content, not the number of redirects to achieve that.
My website is also not indexed by bing, I don’t know what is the error. I contacted with the support team, they told me to check this- Please review our Webmaster Guidelines, especially the section Things to Avoid
Hello,
Sorry for the confusion. The HTTP WWW version of your sitemap is redirecting fine and there is nothing to worry about. For the issue with the status Crawled – Currently not Indexed, there is nothing you can do other than to wait for Google to decide to index the URLs in the SERPs.
And since your site is already indexed in Google then there is no SEO settings issue that will stop it from getting indexed in Bing. Please make sure that your site follows their guidelines and ask their support to check this further.
Please don’t hesitate to get in touch in case you need any other assistance.
Thanks.
I asked them, the told me to check the Things to avoid section. I checked it, I am not violating any of their guideline. Can you please check and let me know what is the issue. If the chat is private I can even give you the password of my wp dashboard, or anything you need.
Hello,
I checked and the website is set to index and not getting blocked by robots.txt. The sitemap is also working fine.
One thing that I noticed is that two variations of your website/sitemap are returning 200 status.
Except for the preferred variation (which should return only a 200 status), all the non-preferred variations of the website should redirect to the preferred variation and return a 301 + 200 status.
Please follow the steps in this link:
https://rankmath.com/kb/couldnt-fetch-error-google-search-console/#5-check-for-the-correct-version-of-the-sitemap and redirect to the correct variation.
You can also get in touch with your web host regarding this.
Once this is fixed, please exclude the sitemaps from being cached. Here’s a guide that you can follow: https://rankmath.com/kb/exclude-sitemaps-from-caching/
Then, clear your website and server’s cache (if any) and give Bing some time to crawl the website again and see if it helps.
Thank you.
I did the same things, waited for couple of days, but it did not worked for me.
As you can see in the screenshot – https://drive.google.com/file/d/1VBmnoA6iOYK-5-ctAWvATPDTH3Jza2DW/view?usp=sharing I have enabled the Robots.txt in my pages but still in search console it is showing that google bots are able to fetch and crawl that page, it is causing the problem- https://drive.google.com/file/d/1Z00dsgC3lpEBU5Gopb1dSjF0H1E2JiDT/view?usp=sharing
Hello,
A noindex robots meta tag stops Googlebot from indexing the page and displaying it in the search results. However, it will still crawl and visit the page but as soon as it detects the robots noindex tag it will leave the page. Please further read about noindex by following this link:
https://developers.google.com/search/docs/advanced/crawling/block-indexing
We hope that clarifies your doubts. Please don’t hesitate to contact us again if you have any other questions.
Thank you
When we enable noindex in robots.txt and we put an url in google search console inspection, it shows- URL Blocked by Robots.txt, but I have enabled robots.txt to noindex, but still there is no error. I think google is crawling those pages and because of no content in those pages, it thought my website don’t provide value, so it is not indexing my articles.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
