Robots.txt not shown on google

#342905
  • Resolved Ahmed Ali Butt
    Rank Math free

    I have a robots.txt in my WordPress site but tools and google shows 404 error or missing, Kindly resolve this issue.

Viewing 5 replies - 1 through 5 (of 5 total)
  • Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    Rank Math should create a default robots.txt virtually on your site if there’s no existing static robots.txt file in your website’s root directory.

    Could you please check if your site’s directory is under the root? Or you are using a subfolder for that site? Please also share your website URL so we can check.

    Looking forward to helping you.

    Thank you.

    https://allstartechnologies.co.uk/
    Here is my site URL you can check the site and please tell me what the problem.

    Hello,

    I can check that your robots.txt file is returning a 404 error. Please make sure that there is no robots.txt file in your site’s root directory. If the issue persists even after that then please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Robot.txt issue resolved.

    Kindly check the sitemap of my site, It cannot contain full urls of my site like website development, writing, digital marketing, and seo service
    Url of sitemap is here,
    https://allstartechnologies.co.uk/sitemap_index.xml

    Hello,

    I’m not quite sure whether I fully understand your concern. But I’ll do my best, and please let me know if I misunderstood.

    Those pages you have mentioned are already included in your page sitemap here under services:
    https://allstartechnologies.co.uk/page-sitemap.xml

    Also, the service page on your site is built as a page, and those pages you mentioned are subpages of services.

    I hope that helps.

    Thank you.

Viewing 5 replies - 1 through 5 (of 5 total)

You must be logged in to reply to this ticket.