Probleme 404 page à cause de Allow: /wp-admin/admin-ajax.php

Hello,

Nous sommes désolés pour le problème que vous avez rencontré avec les pages de votre site. Il est possible que l’ajout de la ligne Allow: /wp-admin/admin-ajax.php dans votre fichier robots.txt ait causé des problèmes de page 404.

Il est important de noter que la ligne Allow: /wp-admin/admin-ajax.php est généralement ajoutée pour permettre aux moteurs de recherche de crawler le fichier admin-ajax.php situé dans le répertoire /wp-admin/. Cependant, dans certains cas, cela peut entraîner des problèmes si mal configuré ou si cela interfère avec d’autres paramètres du site.

Si vous avez retiré cette ligne et que vos pages fonctionnent correctement à nouveau, il est recommandé de ne pas inclure cette règle dans votre fichier robots.txt pour éviter tout problème futur.

Si vous avez d’autres questions ou avez besoin d’aide supplémentaire, n’hésitez pas à nous le faire savoir. Merci d’avoir soulevé cette préoccupation.

Sources:
How to Fix the ‘Blocked Due to Other 4xx Issue’ Error » Rank Math
What Are the Best Robots.txt File Rules for Multisite? » Rank Math
Rank Math Sitemap Issues and Their Fixes » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
Can I NoIndex PDF Files Using an SEO Plugin? » Rank Math

Hello,

Thank you for contacting us and sorry for any inconvenience that might have been caused due to that.

Please note that WordPress uses the admin-ajax.php file to refresh data on pages without reloading the pages. You should allow /wp-admin/admin-ajax.php in robots.txt as it lets Google crawlers see how your site is constructed including CSS, JS, and Ajax files.

In this case, can you please confirm where you’ve added this line on your website? You should add this to your robots.txt file and it should not cause any 404 issues.

Looking forward to helping you.

Thank you.

Hello,

Could you please try to add the following line again on your robots.txt file so that we can check the issue further for you?

Allow: /wp-admin/admin-ajax.php

Looking forward to helping you.

Thank you.

Hello,

Can you confirm if the error still occurs or if the issue has been resolved?

However, if the issue persists, we might need to take a closer look at your website and settings. Please follow these steps:

• Edit the first post on this ticket and include your WordPress and FTP logins in the Sensitive Data section. This is a secure section that only our support staff can access.
  
• Make sure you take a complete backup of your website before sharing the information with us.
• If you prefer, you can use this plugin to generate a temporary login URL to your website and share that with us instead: https://wordpress.org/plugins/temporary-login-without-password/
• You can also use this plugin to monitor what changes our staff might make on your website (if any): https://wordpress.org/plugins/wp-security-audit-log/

We appreciate your cooperation and patience.

Thank you for choosing Rank Math.

Hello,

We logged in to your site with the details provided in the sensitive data section and added the rule we shared here without issues.

The pages on your site load without any error.

Please confirm this fix and let us know if it works on your end.

Looking forward to hearing back from you.

Thank you.

Hello,

Can you share the URLs of those product pages set to noindex?

We checked several of your product pages and found them set to index

We look forward to hearing back from you.

Thanks.

Hello,

As mentioned before we looked at the URLs shared and we can see that they are not set to noindex and you can check the same by looking at the source code of the page you mentioned.

Here’s a screenshot of the current robots meta settings of that product page:

You can see that the metadata shows as index so the report from GSC could be from an earlier version of the page and it would go away as soon as the Googlebot crawls this page again.

Don’t hesitate to get in touch if you have any other questions.

Hello,

Yes, you are right. You would have to wait for Google to crawl those pages again and update their status.

Don’t hesitate to reach out to us if you have further inquiry or concerns.

Thanks.