Hello,
Thank you for contacting Rank Math, and sorry for any inconvenience caused.
I checked the robots.txt, you have disallowed / in the robots.txt, which is why the URLs are blocked by the robots.txt
We recommend using the default robots.txt file with the following rules:
User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://humbaa.com/sitemap_index.xml
You can edit the robots.txt file with Rank Math by going to Rank Math > General settings > Edit Robots.txt
Here is a guide for your reference:
https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/
Once done, clear your website cache and check the URL again with the URL Inspection tool in Search Console.
For the Visible plugins, we check for the publicly available plugins and notify you as this can easily expose a security vulnerability on your site. You can check this link for more information: https://rankmath.com/kb/seo-analysis/#visible-plugins
If the list of plugins installed on your website is public, then your website becomes an easy target for hackers. So, it is important that you secure your website and your web server.
https://mythemeshop.com/blog/web-server-security/
For the couldn’t fetch error, please follow this guide:
https://rankmath.com/kb/couldnt-fetch-error-google-search-console/
Looking forward to helping you.
Respected sir,
I am glad to see your reply sir, but frankly I am a non techie person, will you please help me from your side? Can I share you my wordpress login details sir?
Please I request to you sir.
Hello,
It seems like there is a robots.txt file present in the root folder of your website.
Could you please share the FTP login details in the sensitive data section so we can check?
We look forward to helping you.
Hello,
I have updated the sensitive data as requested. Can you please check further?
Thank you.
Hello,
I can’t seem to locate the folder for your website in your FTP, could you please share the correct path for us? We need to delete the existing robots.txt in your website directory so we can generate the correct one.
Looking forward to helping you.
This is the excat path but I am not seeing robots.txt placed here
/home/master/applications/vzmxeqraxa/public_html
Hello,
I was able to locate the robots.txt file and I removed it so Rank Math can take over in generating a virtual robots.txt file. This should resolve the issue with regards to the “blocked by robots.txt”.
For the visible plugins, I installed this plugin to hide the names. Kindly check from your end.
As for the sitemap, I flushed your sitemap cache and the sitemap page is loading correctly.
Please remove all your sitemaps from your GSC and resubmit only the primary sitemap (sitemap_index.xml).
Let us know how that goes. Looking forward to helping you.
Respected sir, kindly check the screen shot, I tried to submit the URL but still have the issue as, Sitemap and post URL both not working well
https://humbaa.com/eye-care-tips-in-marathi/
https://ibb.co/d20CXrG
https://ibb.co/R4wwk6j
https://ibb.co/M6PFgvP
Kindly fix this issue sir, help me sir, I am loosing my visitors.
Respected sir, kindly check the screen shot, I tried to submit the URL but still have the issue as, Sitemap and post URL both not working well
https://humbaa.com/eye-care-tips-in-marathi/
https://ibb.co/d20CXrG
https://ibb.co/R4wwk6j
https://ibb.co/M6PFgvP
Hello,
I checked and the robots.txt is still having the Disallow: / rule. I checked via FTP but was unable to locate an active robots.txt file. I also tried creating a file with the default rules but the file’s content is not shown when accessed via the URL.
It seems like you’ve removed the WordPress logins from the sensitive data section of this ticket. Please also add the logins again so that we can investigate further.
Looking forward to helping you.
Thank you.
Please kindly let me know if you need any details, please solve the issue as soon as possible
Hello,
It seems that your robots.txt is still heavily cached. You can tell it was cached if you add this parameter ?1 in your robots.txt file URL. https://humbaa.com/robots.txt?1. The correct robots.txt configuration will show.
Please contact your host and see if they can clear your Cloudflare cache (or any server-level caching app you have). See if the issue goes away after doing so.
Let me know how it goes. We are looking forward to helping you.
Good morning sir, kindly let me know the exact issue sir
I cleared the cache of Cloudflare, kindly help me as my website is Google News approved. I have to update it soon.
Hello,
I can check that your robots.txt file is working fine now. Please remove all previously submitted sitemaps from your GSC account and resubmit your main sitemap.
The issue should be resolved once Google recrawls your sitemap.
Let us know how that goes. Looking forward to your update.
Thanks.
Sorry sir,
the site map opening smoothly but, It couldnt fetched in the Google search consol. Also I am trying to submit “Other links” still the issue there.
https://ibb.co/J20qsTP
https://ibb.co/VNbc7kc
https://ibb.co/QXzMrvj
Sir, take my request personally, you can “Delete the Rank math plugin and reinstall it again, and try please for me
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
