old urls keep showing up in 404 monitor

#89283
  • Hello,

    I am a bit boggled by the following and hope you can help me.

    I am looking at the 404 monitor daily and there are these ‘user agents’ that apparently try to access url’s that do not exist anymore. The agents seem to be all kind of bots if I interpret the info correctly (things like: Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html), Googlebot, Bingbot, etc.)

    The urls that the bots try to access used to exist before I switched hosting provider, built a new site and transfered the domain name I was using already for the old site to this new site.

    I have set up RankMath to submit sitemaps to Google Search Console and this is succesfully done. So why do googlebots and alike seem to actively try to access old urls?

    Would be great if you could explain.

    Thanks and keep up the good work,
    Cheers,
    Jeroen

Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    Usually, those bots check old URLs several times before “deleting” them from their databases to check if you restored them or if it was just a temporal issue.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Thanks Alberto,

    Clear answer! It is suprising though that I have changed to the new site with a new url structure already over 3 months ago. And still the bots check for the old urls. But if this all normal I guess I should not think much of it.

    Cheers,
    Jeroen

    Hello,

    We are glad we could assist you.

    If the URLs showing 404 errors are post/page URLs you can choose to also redirect them with Rank math redirection option.

    Hope that helps. If you have any further question(s), please let us know. Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this ticket.