Query For Robot.txt

#886161
  • Resolved Harsh
    Rank Math free

    This is to inform you that I am using RankMath plugin and need to confirm that we have updated our robot.txt file a month ago and now we are checking the file roboxt.txt in “cpanel” The file is missing. Do we need to add it manually at “cpanel”? Please let us know, or we can relay on the RankMath plugin for robot.txt configurations.

    If it is necessary to add the robot.txt file in cpanel please suggest how to add it and when to add like we have to disable the plugin or what we have to do. Please suggest.

    Also, please advise on how to remove unwanted URLs from Google permanently. If I use Google Search Console Tools for URL removal it’s periods for 6 months. It is temporary URL removal or permanent removal.

    I request you please look into this matter and thankful for your response.

Viewing 1 replies (of 1 total)
  • Hello,

    Thank you for contacting Rank Math support.

    Please note that the robots.txt that Rank Math creates is a virtual file and it will not appear on your site’s root when you check it via your cPanel file manager or any file manager.

    A virtual file, like the robots.txt and sitemap.xml files that Rank Math creates, is created on the fly at request time so it will not appear on your files list when you check for it. If you are having trouble with your robots.txt file, you can check this guide – and if that doesn’t help, we’re happy to.

    Regarding removing a webpage from Google. The best way to do this is by setting the page to noindex or better still, permanently delete the page. Redireting the page to another page should also work. But these options are not as instant like removal tool. Which is why the best way to go about this is to remove the URL using the removal tool, then use the other options I shared to prevent re-indexing.

    We hope this helps clarify the issue. Please let us know if you have any other questions or concerns.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 1 replies (of 1 total)

The ticket ‘Query For Robot.txt’ is closed to new replies.