🎅 Christmas Sale: 35% DISCOUNT + 2x Benefits + $15K+ Offers!

blocked by robots.txt

#285703

Resolved Nicole Marie DePalma
3 years, 1 month ago

Rank Math free

My website is having a warning in google search console, indexed although blocked by txt. In rankmath robots txt file, I have:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: tracheostomyeducation.com/sitemap_index.xml

However, when I use the robots txt tester it has:
User-agent: *
Disallow: /

I have already flushed the cache. What else can I do?

Viewing 3 replies - 1 through 3 (of 3 total)

Miguel
3 years, 1 month ago

Hello,

Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

You can try to refresh the version of the file Google is seeing by following the instructions here: https://developers.google.com/search/docs/advanced/robots/submit-updated-robots-txt#refresh-googles-robots.txt-cache

Hope this helps solve your issues.

Don’t hesitate to get in touch if you have any other questions.

Nicole Marie DePalma
3 years, 1 month ago

Rank Math free

Search console is still indicating that the site is indexed although blocked by txt. In rankmath robots txt file, I have:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: tracheostomyeducation.com/sitemap_index.xml

The robots tester is now accurate. Is there something I am missing?

Prabhat
3 years, 1 month ago

Rank Math agency

Hello,

I checked the robots.txt on your website and it seems fine. Please clear your website’s cache and follow this guide to validate the fix and see if the issue gets fixed: https://rankmath.com/kb/indexed-though-blocked-by-robots-txt-error/#conclusion

Hope this helps.

Thank you.

RankBot
3 years ago

Hello,

Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘blocked by robots.txt’ is closed to new replies.