Assistance Needed with Googlebot Fetching Issue on mudah-oem.com

Hello,

We apologize for the issue you are facing with Googlebot not being able to fetch your robots.txt file. Thank you for providing the details of your current robots.txt configuration.

From the content you shared, it seems that your robots.txt file is set up to disallow access to the /wp-admin/ directory while allowing access to admin-ajax.php. This configuration should not inherently block Googlebot from accessing your site or the robots.txt file itself.

Here are a few steps you can take to troubleshoot and resolve this issue:

1. Check Accessibility: Ensure that your robots.txt file is accessible by visiting `https://rankmath.com/wp-content/uploads/2024/04/image-124.png in your browser. If you can see the file without any errors, it means it’s accessible.

2. Use Robots Testing Tool: Utilize the Robots Testing Tool to check if there are any directives blocking Googlebot. Enter your URL and select Googlebot as the user agent to see if it can access your site.
   

3. Clear Cache: If you have caching plugins or server-side caching enabled, clear the cache to ensure that Googlebot is fetching the latest version of your robots.txt file.

4. Check Server Configuration: Sometimes, server settings or security plugins can inadvertently block access to certain files. Ensure that there are no server-level restrictions preventing Googlebot from accessing your robots.txt file.

5. Review Google Search Console: After making any changes, go back to Google Search Console and request a re-fetch of your robots.txt file. This can sometimes resolve indexing issues.

If after following these steps the issue persists, please reply to this ticket, and a human agent from the Rank Math Support team will assist you further.

Thank you for raising this concern, and we hope to help you resolve it soon!