indexing issue – Discovered but not indexed

#445617
  • Resolved Aaron Blum

    3 years, 3 months ago

    Rank Math free

    Hi There,

    I noticed that RankMath identified 40 pages that have been discovered, but not indexed.

    I believe that this was due to the disallow tag being applied to the Robots.txt file. I logged into the root file and delete the disallow tag.

    However, it looks like it continues to show up, even after it has been deleted.

    It shows up like this:
    “User-Agent: *
    Disallow:”

    Does it take time for the change in the root folder to be applied?

    My goal is to get all of our pages properly indexed, but I am not sure what the next step would be.

    Any assistance you can provide would be great!

    Thanks so much!

    – Aaron

Viewing 1 replies (of 1 total)
  • Anas

    3 years, 3 months ago

    Rank Math business

    Hello,

    Thank you for contacting Rank Math, and sorry for any inconvenience caused.

    The robots.txt file is not blocking the URLs, however, we recommend using the default rules:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/#default-rules

    The Discovered – currently not indexed status means that Google already knows about these URLs, but they haven’t indexed them yet.

    Here is what Google says about this status:

    Discovered – currently not indexed: The page was found by Google, but not crawled yet. Typically, Google tried to crawl the URL but the site was overloaded; therefore Google had to reschedule the crawl. This is why the last crawl date is empty on the report.

    You need to wait for Google to crawl and index those URLs.

    Hope this helps.

    Thank you.

    RankBot

    3 years, 2 months ago

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘indexing issue – Discovered but not indexed’ is closed to new replies.