Robots.txt fille-tags not indexed-many pages not indexed - Support

Resolved Linda Todd
1 year, 1 month ago

Rank Math pro

I sent this email to Bhanu and he said to send it to you:

I received a console email, and I have more unindexed files all over the place, tags, etc. It states that it is due to the Robots.txt file. Of course, RankMath writes this. It seems that nothing is like it once was on the website, as more pages, etc., were indexed and in the sitemap.

I have tried to read your documentation etc. but I do not know how to change the Robot.txt file to add the tags and to get all of my pages indexed. GOOGLE IS BEING MEAN!!! IT SEEMS.

I am going to show you my downloads and the information and you will see why I am frustrated. Ever since I changed the domain name previously…everything has gone downhill and to nothing.

Can you please just look at this and tell me how I can get the unindexed pages that are supposed to be in the sitemap indexed and the Robots.txt file issues?

This is what they say should be in the Robots.txt – I am sure that is not the only thing but for the tags to be allowed.

User-agent: *
Allow: /tag/
The robots.txt file is incorrect they state.

User-agent: *
Allow: /tag/
The robots.txt file is incorrect they state.

Here are examples of issues:
Tags not indexed
120 posts discovered but not indexed

712 total not indexed

Re-direct errors:
URL
https://lifefaithtruth.com/confidence-in-strong-women/
https://lifefaithtruth.com/10-positive-affirmations-to-inspire-and-motivate-you/
https://lifefaithtruth.com/discovering-the-simple-truth-a-guide-for-clarity-in-life/
https://lifefaithtruth.com/are-you-dealing-with-yesterday/
https://lifefaithtruth.com/your-money/
https://lifefaithtruth.com/lifes-obstacles-build-the-strength-to-overcome/
https://lifefaithtruth.com/shop/printable-collections/
https://lifefaithtruth.com/what-is-a-good-life
https://lifefaithtruth.com/favorite-collections-shop/home-decor-and-garden/
https://lifefaithtruth.com/privacy-statement-au/

I do not know how to upload the files to show all the post that are not indexed here. I could send them in an email.

Thank you,
Linda Todd- https://lifefaithtruth.com

Viewing 3 replies - 1 through 3 (of 3 total)

Miguel
1 year, 1 month ago

Hello,

Thank you for contacting support.

We tried to look for the tag pages on the website but we couldn’t find them and the sitemap doesn’t include them, which usually means that they are set to noindex so even if you make the changes to the robots.txt file that won’t make a difference here.

Our recommendation for most people is to keep the tags set to noindex because those are usually thin content page and don’t server much purpose to a website other than organizing content for better user experience.

As for the pages with a redirection, those are accurate results since the pages you shared are all redirecting to a different page.

The reason Google is reporting those is because it had the previous URL indexed or discovered before and it’s now detecting the redirections on those.

If the redirections were set willingly, there’s nothing to worry about those particular pages.

Don’t hesitate to get in touch if you have any other questions.

Linda Todd
1 year, 1 month ago

Rank Math pro

Thank you for your help.

Princess
1 year, 1 month ago

Hello,

Glad that helped.

Please feel free to reach out to us again in case you need any other assistance.

We are here to help.

Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this ticket.