Robot.txt file - Support

Resolved Nikola Gojkovic
3 years, 2 months ago

Rank Math free

Hi, guys, I have a problem and can’t think of the best solution.
I added AdSense ads on all of my info content manually for best conversion.
But now mobile-friendly google tool renders those pages as desktop pages and makes them not mobile-friendly ( clickable elements to close and text small to read and content wider than screen).
All of which is not true, the pages load fine on android and apple but their tools render them wrongly and now I have more than half of a site “not mobile-friendly” in the GSC

All I found was that on the page partially loaded report the robot.txt file that blocked this: > file in Sensitive Data
I don’t have a robot.txt file for my site and it’s probably made by RankMaht.

Is this situation known to you and can you help me somehow?

Viewing 5 replies - 1 through 5 (of 5 total)

Anas
3 years, 2 months ago

Rank Math business

Hello,

Thank you for contacting Rank Math and sorry for any inconvenience caused.

I don’t believe that this is related to Rank Math since the plugin does not modify the layout of your pages. The errors reported on the search console are related to your theme and the layout of your pages.

You can test the live URL in Search Console and if it passes the test, submit it for validation.

Looking forward to helping you. Thank you.

Nikola Gojkovic
3 years, 2 months ago

Rank Math free

You didn’t understand. The layout is fine the site looks good on mobile and on desktop. Just the tool in Search Console the live URL mobile-friendly test tool renders the page as it is on a desktop. The only thing that it finds is that robot.txt blocking some adsence files and I don’t have a robot.txt it could only be rankmath
Anas
3 years, 2 months ago

Rank Math business
Hello,

Could you please share a screenshot of the error in the Search Console?

Also, you have a robots.txt for your site. (Please check the attached screenshot in the sensitive data section)

If your robots.txt is managed by Rank Math please try to change the content of the file by going to Rank Math > General Settings > Edit Robots.txt

Please note that you will only be able to edit the robots.txt file from Rank Math if you do not have the robots.txt file in the root folder of your site. If you have, please delete it from there.

Your robots.txt file should look something like this:
```
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://yourdomain.com/sitemap_index.xml
```
I hope this helps. Looking forward to helping you.
Nikola Gojkovic
3 years, 2 months ago

Rank Math free

File from the root is deleted

The robot.txt on rank math is :
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://yourdomain.com/sitemap_index.xml

Google is not indexing any of the pages – error robot.txt is blocking Googlebot

The google robot testing tool keep bringing this robot.txt file that is no longer there
User-Agent: *
Allow: /ads/preferences/
Allow: /gpt/
Allow: /pagead/show_ads.js
Allow: /pagead/js/adsbygoogle.js
Allow: /pagead/js/*/show_ads_impl.js
Allow: /static/glade.js
Allow: /static/glade/
Allow: /tag/js/
Disallow: /
Noindex: /
Despite me submitting and asking google for an update
Only thing that could do this is the SEO plugin

Anas
3 years, 2 months ago

Rank Math business

Hello,

If you have deleted the robots.txt file from the root directory, please clear the website cache, and if you are using Cloudflare, purge the cache from there too.

If the issue persists, We might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

https://wordpress.org/plugins/temporary-login-without-password/

You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

https://wordpress.org/plugins/wp-security-audit-log/

We really look forward to helping you.

RankBot
3 years, 1 month ago

Hello,

Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

The ticket ‘Robot.txt file’ is closed to new replies.