Hello,
Thank you for contacting the support, and sorry for any inconvenience that might have been caused due to that.
Upon checking your website here, it seems you have added a robots.txt with incorrect configuration as you can see in the screenshot in the Sensitive Data section.
If you are still using the SEO tool “Attracta SEO Tools”, you may need to disable its robots.txt and allow Rank Math to generate a default configuration.
If this robots.txt file of yours is present in your root directory, you may also need to delete it as well.
Hope that helps and please do not hesitate to let us know if you need our assistance with anything else.
Thanks, Jeremy for the help.
I contacted the hosting support for this issue and they said I need to request reindexing. They made some changes there. Can you check to see if it’s okay now?
https://i.imgur.com/BYCAe4i.png
So now I have to request indexing from Google only for the page with “Uncensored” or for the site address?
Can you check, please?
And I don’t use “Attracta SEO Tools” anymore.
Thank you!
Hello,
The robots.txt is still incorrect.
Please remove the robots.txt file generated by Attracta SEO Tools, if it is present in the website’s root directory, delete it and make sure that the robots.txt looks like this:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://www.yourdomain.com/sitemap_index.xml
Replace yourdomain.com with your domain name.
I hope this helps. Looking forward to helping you.
Hello,
Ok, The situation was a bit revised and they told me that currently no robots.txt file in my website’s root directory. And was added all the necessary rules:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://www.totaljav.com/sitemap_index.xml
Can you check now please to see if is ok now?
Thanks!
Hello,
I’ve checked your robots.txt, and it seems to be correct now. The URL is also included in your sitemap, and already set to index.
You can now head over to your Google Search Console account and click the validate fix button and give Google some time to validate the URLs.
I hope that helps.
Thank you.
Ok, Reinelle , thanks.
One more thing, please!
The sitemap address was added exactly as in the image above with “www” by Anas. But the address is working in the address bar in the browser without “www”.
So, in robots.txt must be added exactly the same with “www” in the address no? Like this:
Sitemap: https://www.yourdomain.com/sitemap_index.xml
Thanks!
Hello,
If the final URL of your website is without www, then you should add the Sitemap URL without www.
Sitemap: https://yourdomain.com/sitemap_index.xml
I hope this helps.
Thank you.
Hello,
Thanks a lot for the help guys. All adjustments have been made now, and I requested Google to reindex problem pages. I hope to be ok from now on.
Thanks!
Hello,
We are super happy that this resolved your issue. If you have any other questions in the future, know that we are here to help you.
If you don’t mind me asking, could you please leave us a review (if you haven’t already) on https://wordpress.org/support/plugin/seo-by-rank-math/reviews/#new-post about your overall experience with Rank Math? We appreciate your time and patience.
If you do have another question in the future, please feel free to create a new forum topic, and it will be our pleasure to assist you again.
Thank you.
