I am a bit boggled by the following and hope you can help me.
I am looking at the 404 monitor daily and there are these ‘user agents’ that apparently try to access url’s that do not exist anymore. The agents seem to be all kind of bots if I interpret the info correctly (things like: Mozilla/5.0 (compatible; SemrushBot/6~bl; +http://www.semrush.com/bot.html), Googlebot, Bingbot, etc.)
The urls that the bots try to access used to exist before I switched hosting provider, built a new site and transfered the domain name I was using already for the old site to this new site.
I have set up RankMath to submit sitemaps to Google Search Console and this is succesfully done. So why do googlebots and alike seem to actively try to access old urls?
Would be great if you could explain.
Thanks and keep up the good work,
You must be logged in to reply to this ticket.