Hello,
We apologize for the issue you are facing with the reCAPTCHA when your AI bot tries to access the XML sitemap generated by Rank Math. This behavior is likely due to security measures in place to prevent automated access to your site.
To address this, you can consider the following options:
-
Whitelist the IP Addresses: If you know the IP addresses of the AI bot, you can whitelist them in your security settings or firewall to allow them access without triggering reCAPTCHA.
-
Adjust Security Settings: If you are using a security plugin or service (like Cloudflare), check their settings to see if you can adjust the sensitivity of the bot detection features. You may be able to lower the security level for specific IPs or user agents.
-
Disable reCAPTCHA for Specific URLs: Some security plugins allow you to disable reCAPTCHA for specific URLs. If your plugin supports this, you could disable it for the sitemap URL.
-
Contact Your Hosting Provider: Sometimes, hosting providers have additional security measures in place. It might be worth reaching out to them to see if they can assist in whitelisting the bot’s IP or adjusting security settings.
If these solutions do not resolve the issue, please reply to this ticket, and a human agent from the Rank Math Support team will take over and provide further assistance.
Thank you for raising this concern!
The bot response is simply saying “To help us keep this website secure, please solve the recaptcha below to verify you’re not a robot” or do you think this is coming from Wordfence?
Hello,
Thank you for contacting Rank Math support.
The security page is not coming from our plugin. Your server or firewall settings must be doing that to prevent bots from crawling the site. You can check with your host or firewall’s support to fix this.
Please do not hesitate to let us know if you need our assistance with anything else.
Thank you, I cant find any settings for that, and it doesnt happen all the time only on some occasions.
Hello,
You should check with your host, as server bot protection could be blocking bots.
Please do not hesitate to let us know if you need our assistance with anything else.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.