Hello,
We apologize for the issue you are facing with the URLs showing in your Search Console. It seems that these URLs with the .shtml extension and different ID numbers may be related to sensitive data or dynamic content generated by your website.
To address this issue, you can take the following steps:
- Check for Redirects: Ensure that these URLs are not incorrectly configured to redirect to other pages. You can use the URL Inspection Tool in Google Search Console to check their status.
- Review Your Site’s Structure: If these URLs are not meant to be indexed, consider adding them to your
robots.txt file to prevent search engines from crawling them.
- Use Canonical Tags: If there are valid pages that should be indexed, make sure they have canonical tags pointing to the preferred version of the page.
- Remove Unwanted URLs: If these URLs are not necessary, you can request their removal through Google Search Console.
For more detailed guidance on fixing indexing issues, you can refer to our article on how to fix indexing issues in Google Search Console.
If you need further assistance, please reply to this ticket, and a human agent from the Rank Math Support team will take over and provide more specific help. Thank you for raising this concern!
I have checked all of this, but the problem is not getting fixed.
Hello,
In your Google Search Console, you should use the URL inspection tool of your GSC account to inspect those URLs and check the referring page where they are coming from.
Once you know their referring page, you can remove or update them so Google won’t discover those kinds of URLs.
You can also share the status of those URLs in your GSC so we can check the URLs and advise further.
Looking forward to helping you.
Hello,
Unfortunately, Rank Math doesn’t generate these URLs on your website. However, if you want, you can add the following disallow rule to prevent Google from crawling these URLs:
Disallow: /*.shtml
Here’s a guide on how to edit your robots.txt using Rank Math:
https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/
Once done, allow Google some time to re-crawl your site to reflect the changes.
Hope that helps and please don’t hesitate to let us know if you have any other questions.
Thank you.
Hello,
Glad that we could address your concern.
Don’t hesitate to get in touch with us if you have any other questions.
