Hello,
Thank you so much for getting in touch.
There are no settings in Rank Math that would make those folders indexable.
However, you can ask Google and other search engines to stop crawling those folders by adding this text to the robots.txt file at WordPress Dashboard > Rank Math > General Settings > Edit robots.txt:
User-Agent: *
Disallow: /wp-content/
Disallow: /wp-includees/
Allow: /wp-content/images/
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Thanks for the prompt response and support.
I had already considered that solution but I understand that it is important that Google can crawl those files. Mainly the indexed files are .php files and blank directories.
From what I am seeing on the net is that it is a problem that is happening to several people.
I already requested that they be removed in Google Search Console.
What I don’t know is how I can only not-index those files and folders. Any other ideas what to do?
Thank you
Hello,
The way to keep any URL from indexing/crawled is usually by adding a noindex tag. Given these are not wordpress pages that we can add a noindex robots meta tag, the alternative is to use the robots.txt by adding the statements as suggested by my colleague.
You can also add specific URL paths to the robots.txt if yo only want specific URLs not indexed.
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
