XML site map error

Hello,

You’re getting this error because your robots.txt file is showing this:

Please navigate to Rank Math > General Settings > Edit robots.txt and add the following default Rank Math robots.txt rules:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://www.onlyway.store/sitemap_index.xml

After adding the rule, you can clear your site and browser cache and try again.

We hope this helps you resolve the issue. Don’t hesitate to contact us again with any other questions or concerns regarding Rank Math. We are always happy to help.

Thank you for choosing Rank Math!

Hello,

To fix the error, you should delete the physical robot.txt file from the root of your WordPress installation. If you’re unsure how to do this, feel free to contact your website hosting company for assistance.

You can find more information here: https://rankmath.com/kb/cant-edit-robots-txt/#num-1-presence-of-a-physical-file

If you need further assistance, don’t hesitate to reach out.

Hello,

This can happen when you use a content delivery network (CDN) like Cloudflare. Rank Math does not create a physical robots.txt file on your site. Instead, the file is created and displayed when a user visits your robots.txt URL. So you can safely ignore this error if your robots.txt file is available at https://yourdomain.com/robots.txt. This follows SEO best practices and Googlebot will be able to follow the rules in your robots.txt.

Alternatively, you can also add this rule in your Robots.txt:

Disallow: /cdn-cgi/

Here is a guide that can help: https://rankmath.com/kb/fix-common-robots-txt-issues/#robots-txt-is-not-valid-in-pagespeed-insights

You can check this guide to learn how to edit your robots.txt file using Rank Math: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

Hope that helps and please do not hesitate to let us know if you need my assistance with anything else.

Hello,

Your robots.txt already contains those rules, so you can skip adding them.

You can also visit it at this link: https://www.onlyway.store/robots.txt

Looking forward to helping you.

Hello,

We mean that the current rules in your robots.txt are correct and follow SEO best practices.

You can test your robots.txt file to confirm yourself using this tool: https://technicalseo.com/tools/robots-txt/

The rule: Disallow: /cdn-cgi/ is to block the Cloudflare endpoints since Search engine crawlers can encounter errors when crawling these endpoints and — though these errors do not impact site crawling or rankings — they may surface in your webmaster dashboard

SEO and other web crawlers may also mistakenly crawl these endpoints, thinking that they are part of your site’s content.

Please refer to this thread: https://support.google.com/webmasters/thread/186999666/cloudflare-cdn-cgi-endpoints-indexed-though-blocked-by-robots-txt?hl=en

So, if you use Cloudflare, you can have the following in the robots.txt file instead:

User-agent: *
Disallow: /wp-admin/
Disallow: /cdn-cgi/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.onlyway.store/sitemap_index.xml

We hope this helps. Please let us know if you have further questions or concerns.

Thank you.

Hello,

Glad that helped.

If you have any other concerns, please don’t hesitate to contact us anytime so we can assist you further.

Looking forward to helping you.