Hello,
I understand that you are trying to stop Google from crawling attachment image URLs in Google Search Console and have attempted to block it using robots.txt without success. To prevent Google from crawling attachment image URLs, you can follow these steps:
-
Check Your Current robots.txt File:
- Use the Robots Testing Tool to check your current robots.txt file.
- Ensure that there are no directives blocking Googlebot from accessing your site.
-
Edit Your robots.txt File:
- If you find any directives like
Disallow: /, remove them to allow Googlebot to crawl your site.
- You can refer to this guide on editing robots.txt with Rank Math for assistance.
-
Use the Robots Testing Tool:
- You can use the Robots Testing Tool to check if Google is blocked from crawling specific URLs on your site.
- Enter the URL in the tool and choose ‘Googlebot’ as the User Agent to test if Google is blocked from crawling the URL.
If you need further assistance or encounter any issues while implementing these steps, please reply to this ticket, and a human agent from the Rank Math Support team will assist you promptly.
Thank you for reaching out with your concern. We are here to help you with any issues you might face.
Best regards.
Sources:
Common robots.txt Issues & How to Fix Them » Rank Math
How to Fix ‘Blocked by robots.txt’ Error in Google Search Console » Rank Math
Hello,
Please share the exact URL of the image so we can suggest the rule to block it in robots.txt
Looking forward to helping you.
xact URL of the image [moved to sensitive data section]
Hello,
The sensitive data section is empty.
Please edit your first post and include the URL there
It is completely secure, and only our support staff has access to that section.
Looking forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
You should use the rule below in the robots.txt file to block Google crawler from crawling the URL you placed in the sensitive data section:
User-agent: Googlebot
Disallow: /how-to-check-cnic-number-with-mobile-phone-number/check-cnic-number-bio-data-online/
User-agent: Googlebot-Mobile
Disallow: /how-to-check-cnic-number-with-mobile-phone-number/check-cnic-number-bio-data-online/
You may refer to this guide to edit robots.txt in Rank Math: https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/
We hope that helps and we are here should you have any follow-up questions.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
. please check given sloution. give robots.txt code+ abd other sloucation
