Hello,
I’m sorry to hear about the issue you are facing with the robots.txt file on your website. It seems like there might be a conflict causing the incorrect sitemap URL to be displayed in the robots.txt file.
To address this problem, please follow these steps:
-
Check for any unintended rules in your actual robots.txt file or the virtual robots.txt file added by Rank Math by going to Rank Math SEO → General Settings → robots.txt.
-
If you have confirmed that there are no conflicting rules in the robots.txt file, you can try adding the below rule to your robots.txt file and test it again:
Disallow: /cdn-cgi/
-
If the issue persists, you can also verify if there is a second robots.txt file in your site’s root directory that might be causing conflicts. You can log into your WordPress root directory using cPanel or an FTP application to check for any additional robots.txt files.
If after following these steps the issue persists, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.
Thank you for reaching out.
Best regards,
Sources:
Rank Math Sitemap Issues and Their Fixes » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
We followed your recommendations above and confirm there are no conflicting rules, we tried adding the disallow, and we verified there isn’t a second sitemap in the directory.
The issue is still persisting.
Hello,
Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.
Could you please try to follow the steps from this guideline to edit the robots.txt file and include the main sitemap https://webjogger.com/sitemap_index.xml: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/
Let us know how it goes. Looking forward to helping you.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.