Hello,
We apologize for the issue you are facing with the 404 monitor logging numerous 404 errors on your site. It seems that the URLs being logged include an IP address, which is not typical behavior. This could be due to various reasons, such as incorrect links or bots trying to access non-existent pages.
To address this, we recommend checking the source of these requests. You can use the User-Agent and Referer fields in the Advanced 404 Monitor to gather more information about where these requests are coming from. This can help you identify if they are legitimate users or automated bots.
If you need further assistance in analyzing these logs or if this behavior persists, please reply to this ticket, and a human agent from the Rank Math Support team will take over and assist you further.
Thank you for raising this concern!
Sources:
How to Monitor 404 Errors with Rank Math SEO Plugin
From one of the site, the majority of the referrer’s are empty and a common user agent that keeps popping up is:
Android Browser 537.36 | Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; s**************@b************)
On another site, we have a bizarre issue where the reported 404 URL is being shown as, for example: [moved to sensitive data section]
Hello,
Please note that we only report the 404s. We do not have information on how or why they are generated. You can try to fix these errors by following this guide: https://rankmath.com/kb/fix-404-errors/
To block out access to bots, you can use a service like Cloudflare (https://www.cloudflare.com/). Cloudflare is a web security and performance service that can protect your site from malicious bots and attacks.
As for the 404 entry in the Sensitive data section, if you see your homepage URL in the 404 monitor, it means that some bots are trying to access this URL: https://yourdomain.com/yourdomain.com
This is because all of the 404 errors are relative to the homepage, so you can safely ignore those and go about your day.
If the error was on your homepage, you would see only a forward slash in the log /.
Don’t hesitate to get in touch with us if you have any other questions.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
