Crawler troubles - Support

Resolved Giuliano Ciolino
1 year, 1 month ago

Rank Math free

I had 2 websites and 4 hostings. I’m on WordPress.org and in common with the old site I have Cloudflare and the WordPress plugins Wpforms, Rank Math and instant Indexing.

Unfortunately, Search Console does not detect URL changes and validations fail. The URLs are non-existent, but checking with Search Console, it says it can be indexed. Other times it sees the URL but doesn’t index it. I understand that the post may be of poor quality, but not indexing it is synonymous with a crawling problem. The site is giocone.com and I don’t know what to do anymore. Even writing great posts I have serious difficulties with crawlers.

Viewing 3 replies - 1 through 3 (of 3 total)

Jeremy
1 year, 1 month ago

Hello,

Thank you for your query and we are so sorry about the trouble this must have caused.

I tried checking your posts on the Google SERP and I can confirm most of your posts are already indexed there which means that Google have crawled them successfully.

Googlebot is also able to crawl your site as you can see in my screenshot below:

If you see any reports that your site is not crawlable by the search engine, can you please share some screenshots of it and the affected URLs?

As for the non-existing URLs that Google still crawls, it may take some time for search engines to adapt when a URL is deleted, kindly give it a couple of days and the URL will be removed from crawling or attempt of indexing.

Looking forward to helping you.

Giuliano Ciolino
1 year, 1 month ago

Rank Math free

Can you help me understand what I’m doing wrong?
I had:
– 2 websites
– 4 hostings
– 3 years time
– I worked on SEO
– I completely rewrote the lyrics several times
– The texts are long. several pages have more than 700 words
– My competitors have little text, so that should be a factor in my favor
– I deal with online games and post them on my site. So I should have people from Google pretty easily with 80 games. I have games that should generate +100 users per game. I don’t expect to get such high numbers, but I have no traffic from Google after years.
– Search Console detects that I have several pages with impressions, but a terrible click rate. I have written the titles several times but have never solved them. I believe there is a block of users going from search engines to my site.
– The sitemap is read. I did a scan with Search Console and it says: No: “noindex” detected in HTTP header “X-Robots-Tag”. it’s normal?

Caleb
1 year, 1 month ago

Rank Math free

Hello,

That is normal because you’re inspecting your sitemap URL in your Google Search Console. You’ll get the error if you inspect your sitemaps because, by default, sitemaps are set to noindex as they are meant to be crawled and not to be displayed on search results pages.

You should only submit your sitemap to the sitemap section of your GSC account and shouldn’t use the URL inspection tool for the sitemap URLs.
https://rankmath.com/kb/submit-sitemap-to-google/

Please don’t hesitate to let us know if you have any other questions.

Thank you.

RankBot
1 year ago

Hello,

Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘Crawler troubles’ is closed to new replies.