URL Blocked by Robots.txt

#22306
  • Resolved Sparklife
    Rank Math free

    getting an error in the search console https://prnt.sc/q6zv7x all other urls seem fine. This has also affected the traffic to my site.

    Even when i do a live test on the urls mentioned in the sensitive data section,,,google just dont seem to fetch the urls can you please fix?

    • This topic was modified 5 years ago by Sparklife.
Viewing 5 replies - 1 through 5 (of 5 total)
  • Michael Davis
    Rank Math pro

    Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    After inspecting your homepage source code it looks like this page is missing a lot of meta tags including the robots tag that controls indexing.
    Could you please edit this page and then resave it and check if this will fix the issue?
    The other link does not have any errors, please delete your page cache and test again on the live URL test.

    Looking forward to helping you. Thank you.

    ​​​​​​​

    Sparklife
    Rank Math free

    sorry but i am clueless about changing the page source and adding meta tags…could you please help

    Michael Davis
    Rank Math pro

    Hello,

    Thanks for getting back to me.

    I would be happy to help. Please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Sparklife
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Michael Davis
    Rank Math pro

    Hi there,

    Thanks for the follow up.

    I am unable to make changes to your theme files from the admin dashboard.
    Please add the following snippet of code to your functions.php file via FTP:

    /**
     * Allows filtering of the robots meta data.
     *
     * @param array $robots The meta robots directives.
     */
    add_filter( 'rank_math/frontend/robots', function( $robots ) {
    	if(is_front_page()){
    		$robots['index'] = 'index';
            $robots['max-snippet'] = 'max-snippet:-1';
    		$robots['max-video-preview'] = 'max-video-preview:-1';
    		$robots['max-image-preview'] = 'max-image-preview:large';
    		return $robots;
    	}
    	return $robots;
    });

    Your page is also missing a meta description. Please head over to Rank Math > Titles & Meta > Home page > Homepage Meta Description and enter your custom text description on the field.

    I hope this info helps. Thank you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘URL Blocked by Robots.txt’ is closed to new replies.