Hello,
Thank you for contacting us.
I checked the robots.txt file on your website and I found 2 disallow statements.
Disallow: /calendar/action*
Disallow: /events/action*
Could you confirm if you added these rules intentionally? If yes, then there’s nothing to be worried about.
However, could you share some of the affected URLs so that we can check if they are the pages that come under the category of the above rules?
Looking forward to hearing back from you.
Thank you.
Hi,
I did not add this rule. It doesn’t say which pages are effected but I will try to remove the 2 disallow statements.
Hello,
There are some additional rules in your robots.txt file. Also, the sitemap’s URL is not mentioned in the robots.txt. Here’s a screenshot: https://i.rankmath.com/rkzjTM
The default robots.txt file should have the below rules:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://mardenwebdesign.com/sitemap_index.xml
If you’ve not added any rules intentionally, then you can replace the contents of robots.txt file with the above default contents.
Hope that helps.
Thank you.
Thanks file is updated. thanks for the help. I wonder how that happened as I did not change anything?
Hello,
I’ve checked your robots.txt file and I can confirm that it is now updated with the default rules.
Some plugins/themes automatically update the robots.txt files as per their requirement.
However, as you’ve now updated the file, I suggest you clear your website’s cache and wait for Google to crawl your website again and see if the warning gets fixed.
Hope that helps.
Thank you.
Hello,
If you have another question in the future, please feel free to reach out, and it will be our pleasure to assist you again.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
