Hello, I’m sorry to hear that you’re experiencing issues with search engine crawlers. Having a noindex directive in your sitemaps and robots.txt files can indeed cause problems with search engine crawling.
The noindex directive tells search engines not to index specific pages or your entire website, which can lead to your content not being crawled and indexed by search engines.
To address this issue, you should first check your sitemaps and robots.txt files to ensure that there are no noindex directives present. If you find any, you should remove them to allow search engines to properly crawl and index your website.
If you need further assistance with this, please feel free to assign this ticket to a human agent using the available buttons, and we’ll be happy to help you further.
Sources:
Using Rank Math’s ‘Quick Actions’ Admin Menu Item
How to Fix Submitted URL Marked ‘NoIndex’ Error » Rank Math
Advanced Tab in Rank Math SEO’s Meta Box
Why Google Hasn’t Indexed Your Post, Page, and/or Website? » Rank Math
For a few weeks I had robots.txt timeout problems. I solved the problem by having the robots.txt file added to the hosting.
But my rankings have gotten worse. Maybe because the rankings need to be updated again.
Hello,
We can see your robots.txt file is currently set to index. However, please note that even if you set a page to “noindex,” Google can still crawl it. Sitemaps are meant to be crawled, not displayed on search results pages. If you set sitemaps to index, they will appear on SERPs, which you won’t want because sitemaps don’t have any content to show your visitors.
Regarding the ranking issue, to identify the specific reason for the decline in ranking, it’s essential to analyze your website’s performance, conduct a thorough review of your SEO strategy, and monitor changes in search trends and competitors.
You can use this guide to run an SEO audit on your site: https://rankmath.com/blog/seo-audit/
Hope that helps and please don’t hesitate to let us know if you have any other questions.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
