indexing wordpress folders

#207216
  • Resolved Mertcank
    Rank Math free

    Hello there,

    Although all my settings are normal, wordpress folders are indexed.

    indexed folders:

    wp-content
    wp-content/uploads/rankmath
    wp-content/uploads/js-composer

    Robots.txt

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Disallow: /wp-content/uploads/wpforms/

    Also even though I added the favicon, after adding the rankmath it was gone. The favicon does not appear in the search console.

Viewing 9 replies - 1 through 9 (of 9 total)
  • Ankit
    Rank Math business

    Hello,

    Thank you for contacting the support and sorry for any inconvenience that might have been caused due to that.

    The pages are already indexed and showing in the SERPs. For now, you can create empty index.html inside wp-content, uploads, rank math, js-composer and then request google to remove the URL

    You can learn more about remove the URL from Google:
    https://support.google.com/webmasters/answer/9689846/removals-tool?hl=en

    And Google can see the favicon on your website, Give it some time, and it will show it inside the SERPs.

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Thank you. Why are these pages indexed even though robots.txt is also disabled?

    If I let it create its own, will it keep iterating?

    Hello,

    Thank you for the follow-up.

    There are no settings in Rank Math that would make those folders indexable. Your robots.txt only contains a disallow for the path /wp-content/uploads/wpforms/

    However, you can ask Google and other search engines to stop crawling those folders by adding these texts to the robots.txt file at WordPress Dashboard > Rank Math > General Settings > Edit robots.txt:

    Disallow: /wp-content
    Disallow: /wp-content/uploads/rankmath
    Disallow: /wp-content/uploads/js-composer

    The way to keep any URL from indexing/crawled is usually by adding a noindex tag. Given these are not WordPress pages that we can add a noindex robots meta tag, the alternative is to use the robots.txt by adding the statements

    I hope that helps.

    Thank you, and please don’t hesitate to contact us anytime if you need further assistance with anything else.

    Thank you.

    Can you hide the site addresses in the support request?

    Thank you for your help.

    Hello,

    Thank you for the follow-up.

    I’ve already hidden your website in this ticket as per your request.

    Looking forward to helping you.

    Thank you.

    Hello,

    Apologies for missing that part out.

    I’ve already removed all the visible replies with your website in this ticket.

    Looking forward to helping you.

    Thank you.

    Thank you so much.

    Hello,

    You’re welcome.

    We are glad that we have addressed your concerns.

    If you have any other questions, please don’t hesitate to contact us anytime by creating a new ticket to assist you further with anything else.

    Thank you.

Viewing 9 replies - 1 through 9 (of 9 total)

The ticket ‘indexing wordpress folders’ is closed to new replies.