Website becomes inaccessible for Google Search

#91534
  • Resolved Momento
    Rank Math free

    Hello,

    First, I would like to point out that I have been looking for the solution for 3 days (and almost 3 whole nights).
    I even had to reinstall my site, so much I had “tampered with” trying to find.
    So I open this ticket as a last resort.

    My site was working fine.
    Then, in google search,
    my site map was no longer accessible

    When I reinstalled my site (because it became inaccessible after looking for the solution)
    google search accepted my sitemap again
    Then, after a day: blocked again.

    After research, it seems that this is an error with the robot.txt
    He disappeared …
    I tried to create one: it doesn’t work….

    Details and screen shot in the “sensitive data” section

    Thank you for your help, because really, I am at a “dead end”
    thank you

Viewing 10 replies - 1 through 10 (of 10 total)
  • Hello,

    Thank you for contacting the support and sorry for any inconvenience that might have been caused due to that.

    The robots.txt file on your website looks ok, there are no issues there.

    Can you please delete the Sitemaps from Google Search Console and add only the main Sitemap again? The URL would be like:
    https://rankmath.com/sitemap_index.xml

    Then wait for upto 72 hours for Google to crawl everything again.

    Please see if that helps.

    Looking forward to helping you.

    Hello,

    Firstly, thanks so much for your very fast answer and your support (top !)

    1) Google search – sitemap
    I tried do do it before (and wait for to check if it come back).
    I tried one more time just now : The same problem is here
    (screenshot : https://ibb.co/LCtxNdW )

    2) Google search – URL check
    my URL is not accessible by Google Search – check URL
    mistake with robot.txt
    (screenshot : https://ibb.co/KsdcYRB )

    3) robot.txt
    when I key in the URL of robot.txt :
    https://www.momento-resort.com/robot.txt
    I have an error 404 (before it wasn’t)
    note : I tried with an other browser that I use for work or to go on the website to avoid problems of cache.

    Thanks for your attention and your help

    Hello,

    The correct URL is
    https://www.momento-resort.com/robots.txt

    Can you please ask your host if they have any firewall installed that is blocking Google bots?

    Looking forward to helping you. Thank you.

    Hello,

    Thanks for you answer.
    Yes, I checked the correct URL (with an “s” after “robot”) and it’s works.
    So, the problem doesn’t come from here…

    The problem should not come from a firewall for those reason :
    1) My Horst is provided by O2Switch, and they confirm that there’s no firewall witch can block “Googlebot”
    2) the fist time that this problem appear, after too many action in the website, I had to reinstall it from a backup. After this reinstallation, it came back well (URL check by google search : OK / Sitemap update in Google Search : OK)
    3) it’s just after few hours of use that the problem appeared again.

    Right now, I checked one more time in Google Search :

    1) URL Check :
    GOOGLE CAN NOT ACCESS TO YOU URL
    Result : Failed: Error related to redirects
    (the problem could come from your redirection tool ?)

    2) Import sitemap :
    Unable to read sitemap
    Generic HTTP error

    I continue to try also to find a way of solution a solution via internet
    but I didn’t find a solution (and I don’t want to play like « a magician » and destroy one more time my website…)

    Thanks for your attention and your time for to help me.

    Hello,

    You can rule out the issue coming from the Rank Math plugin’s redirections by disabling the Redirections of Rank Math, clearing the cache, and then trying to submit the Sitemap again.

    Can you please follow these steps?
    1. Flush the Sitemap cache by following this video screencast:
    https://i.rankmath.com/xXXhDt

    2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server.

    That should fix the issue. Please let me know if that does not. We are here to assist.

    Also, please enable an error log on your website by asking your hosting to enable it by following this?
    https://www.interserver.net/tips/kb/enable-php-error-log-wordpress-sites/

    Looking forward to helping you. Thank you.

    Hello,

    thank you very much for your feedback.

    About the requested manipulations:
    I had already completed all these steps before contacting you.
    I did them again

    1) Flush the Sitemap cache
    – RankMath / Sitemap: Change link from 200 to 201 + save
    – General setting / Permalink: save
    more
    – flush all caches of my cache plugin (LsCache)
    – flush all caches from CDN (QUIC.Cloud)
    Wait a few hours for the propagation of the cache to clear

    2) Exclude the Sitemap files of the Rank Math plugin in my cache plugin (LsCache): already done

    Now, I did the change in the wp-config.php to activate the DEBUG:
    Value entered.
    define (‘WP_DEBUG’, true);
    define (‘WP_DEBUG_LOG’, true);
    define (‘WP_DEBUG_DISPLAY’, false);

    After these manipulations:
    THE SAME PROBLEMS REMAIN ON GOOGLE SEARCH:
    – URL cannot be accessed = Failed: Error related to redirects
    – SITEMAP Unable to read sitemap = Generic HTTP error (examples HTTP error: 307)

    For information :
    the access link to my site (sensitive data section) is still valid.

    Thank you for your help

    Hello,

    Thank you for sharing the error of HTTP.

    It makes things clearer. It is a server-side error.

    Can you please ask your hosting to use a 301 redirection when redirecting from non-www version to the www version?

    You can use the following website to test and also find a screencast in the sensitive area:
    http://www.redirect-checker.org/index.php

    Hope that helps.

    Hello

    thanks so much for your answer.
    I will ask to my hosting.
    Don’t close the ticket, like this, if the problem is solved, I will be able to place the result (if somebody else have also this problem)

    Best regards and thanks for your time

    Hello,

    the problem has been solved. Here is the explanation:

    My cache plugin: LsCache
    LsCache was well connected to QUIC.cloud
    Since the last update of LsCache, compatibility issue with the CND of QUIC.cloud
    To solve the problem :
    – Disable CND of QUIC.cloud + cache flush
    – Retention of the optimization of QUIC.cloud images
    – Complete empty cache of LsCache
    – RankMath / redirection: change from 200 links to 201 + save
    – General setting / permalink: save
    !!! IMPORTANT !!! : LsCache / Crawler: manual crawl for update

    NOTE for RankMate + LsCache users:
    If sometimes the RankMate sitemap does not update,
    you have to manually “crawl” LsCache twice and changing the position between the 2 crawls.
    => After this manipulation the site map will be up to date

    Thank you very much for taking the time to help me resolve my issue.
    You can close the ticket.

    Best regards.

    Hello,

    Glad that the problem is resolved for you and thank you for sharing it with everyone.

    If it isn’t too much to ask for – would you mind leaving us a review here?
    https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post

    It only takes a couple of minutes but helps us tremendously.

    It would mean so much to us and would go a really long way.

    Thank you.​​

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘Website becomes inaccessible for Google Search’ is closed to new replies.