google search console not indexing and stating errors

#169653
  • Resolved Neel B
    Rank Math free

    I have had errors show on google search console stating there has been an error trying to index 6 of my webpages.

    Submitted URL marked ‘noindex’

    in the RankMath plugin, I also have this preset: the robots.txt file is not writable.

    please see the sensitive data for log-in details without a password.

    please can you assist as I am unsure why I have received this error and the pages cannot be indexed.

    Thanks
    Neel

Viewing 11 replies - 1 through 11 (of 11 total)
  • Hello,

    Thank you for contacting the support, and sorry for any inconvenience that might have been caused due to that.

    Can you please provide these 6 URLs which marked as Submitted URL marked 'noindex' so I can check it on our end?

    As for your robots.txt problem. Please get in touch with your host so that they can help in changing the permissions for the files on your root folder.

    It is also recommended to rename the robots.txt file that is present on your root folder so that Rank Math can generate a virtual robots file.

    We are looking forward to helping you.

    Neel B
    Rank Math free

    Hello,

    Thank you for the follow-up, and sorry for the delay.

    I’ve checked all the links you have shared, and none of them contains the noindex meta tag. However, your sitemap seems to be heavily cached by the W3 Total cache.

    I’ve already excluded your sitemaps from being cached and flushed your sitemap cache as well. Your /robots.txt is already fine. You can rename the static file to anything to disable it and let Rank Math generate your robots.txt

    Please remove all the sitemaps you have submitted in your Google Search Console and resubmit your main sitemap only /sitemap_index.xml and give Google some time to recrawl your website.

    I hope that helps. Thank you, and looking forward to your update.

    Neel B
    Rank Math free

    Hi,

    Thanks for the information.

    1. if I remove the sitemap from GCS, does this loose all the data that I have been collecting then?

    2. do I need to do anything to the robots.txt or is it ok to leave it as it is?

    Thanks.

    Anas
    Rank Math business

    Hello,

    1. If you delete all the sitemaps and add the new sitemap, you would not lose any data in GSC.

    2. Your robots.txt is fine, there is no need to change anything there.

    Let us know if you have any other questions.

    We look forward to helping you.

    Neel B
    Rank Math free

    Could you please confirm the code i need to submit in my GSC for sitemap?

    Is it the full URL or is what has been mentioned above: “/sitemap_index.xml” ?

    and to confirm, do i need to delete the existing site map in GCS before adding it in again?

    Thanks,
    Neel

    Hello,

    Thank you for keeping in touch with us.

    Yes, you may delete all existing sitemaps from your Google Search Console. Submitting a new one should tell Google to do a fresh crawl of your website content.

    You have added a verified website URL in your GSC so you do not need to include your URL protocols, domain and etc. Only the primary sitemap generated by Rank Math: sitemap_index.xml

    You may refer to our handy guide here: https://rankmath.com/kb/submit-sitemap-to-google/

    Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.

    Neel B
    Rank Math free

    i could not delete the current site map, not sure how to so I copy and pasted the map again into the section stated succseffull but status is couldn’t fetch.

    this is causing to be a real mess. whats the best and easiest solution

    Also, having submitted URL not found (404) which is odd for the blog post I have

    Hello,

    Thanks for getting back to us.

    The first thing to do here is to delete all sitemaps currently in your Google Search Console. To do that go to your GSC > Sitemaps > Click the sitemap > Upper right corner, click the 3 dots > Remove Sitemap.

    Then you should submit only one sitemap that is your main sitemap. Add a new sitemap and simply write sitemap_index.xml in the text box.

    Let us know if the sitemap is fetched successfully.

    Looking forward to hearing back from you.

    Neel B
    Rank Math free

    Thanks this has been complted.

    Hello,

    We are glad this issue is already resolved.

    If you have any other concerns, please don’t hesitate to contact us anytime by creating a new ticket to assist you further with anything else.

    Thank you.

Viewing 11 replies - 1 through 11 (of 11 total)

The ticket ‘google search console not indexing and stating errors’ is closed to new replies.