Robots txt restricted googlebot

#451634
Viewing 3 replies - 1 through 3 (of 3 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    Currently your robots.txt file is indeed blocking the access to Googlebot on your website:

    
    # robots.txt generated by smallseotools.com
    User-agent: Googlebot
    Disallow: 
    User-agent: googlebot-image
    Disallow: 
    User-agent: googlebot-mobile
    Disallow: 
    User-agent: googlebot-desktop *
    Disallow: 
    Disallow: /cgi-bin/
    
    Sitemap: https://techinrealtime.com/sitemap_index.xml
    

    ​​​​​​​We would recommend removing the entries that block the Googlebot completely and using the default values like so:

    
    User-Agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    
    Sitemap: https://techinrealtime.com/sitemap_index.xml
    

    Don’t hesitate to get in touch if you have any other questions.

    I have changed

    Hello,

    Glad that helped.

    Please feel free to reach out to us again in case you need any other assistance.

    We are here to help.

    Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 3 replies - 1 through 3 (of 3 total)

The ticket ‘Robots txt restricted googlebot’ is closed to new replies.