Hello,
Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.
I have tested your sitemaps on this tool (https://www.xml-sitemaps.com/) and everything seems working fine (I have added screenshots in the Sensitive Data section).
Could you try to validate those errors? They might be just a temporal server issue and now be working fine.
Looking forward to helping you. Thank you.
​​​​​​​
I think there is another problem. I made an experiment like this on a site where I use this plugin.
domain.com/robots.txt ( robots.txt content viewed)
When I try for my site with sensitive data, robots.txt does not come. There is no file in the root directory. I will create it manually. Would you suggest this? Please look at sensitive data?
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
Thank you for contacting Rank Math today.
I have tested your sites on this tool and the related domain/robots.txt seem to be fine from my end. Please check the attached screenshots.
Looking forward to helping you. Thank you.
​​​​​​
Would you try the same for domain.com/blog? On my blog, robots.txt is completely under rank math control. I do not come when I write domain.com/robots.txt in the URL section.
It should normally come, right?
Hello,
robots.txt can only be at the domain level (so it can’t be a domain/blog level) or search engines won’t look for it.
You can read more about it here: https://developers.google.com/search/reference/robots_txt
If you want to set settings in robots.txt in domain/blog, you have to set them inside the robots.txt in domain
Looking forward to help you.
I have one last question: Should I add the blog part separately when adding a property? Or would I add sitemap on single property? If so, should robots.txt be as follows?
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Allow: /blog
Sitemap: https://domain.com/sitemap_index.xml
Sitemap: https://domain.com/blog/sitemap_index.xml
Hello,
Since the /blog/ is another website, you should add it as another property (https://support.google.com/webmasters/answer/34592?hl=en).
Your robots should be something like this:
User-agent: *
Disallow: /wp-admin/
Disallow: /blog/wp-admin/
Allow: /wp-admin/admin-ajax.php
Allow: /blog/wp-admin/admin-ajax.php
Allow: /blog
Sitemap: https://domain.com/sitemap_index.xml
Sitemap: https://domain.com/blog/sitemap_index.xml
Looking forward to help you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
