Hello,
I apologize for the issue you are facing with adding ChatGPT and others to the robots.txt tester. It seems like there might be a misunderstanding or a technical issue at play.
To manually add user agents like ChatGPT in the Rank Math robots.txt tester, you should follow these steps:
- Open the Robots.txt Tester: Go to the Rank Math Robots.txt Tester.
- Enter the User-Agent: In the user-agent field, you should be able to type in the name of the user agent you want to test (e.g.,
ChatGPT).
- Test the URL: After entering the user agent, enter the URL you want to test and click on the Test button.
If you are still unable to add the user agent, please ensure that you are using the latest version of your browser or try clearing your browser cache. If the problem persists, it would be best to reply to your ticket with more details about what happens when you try to add it, and a human agent from our support team will assist you further.
Thank you for raising this concern!
Sources:
How to Fix the "Indexed, though blocked by robots.txt" Error » Rank Math
I have tried again and same result, won’t let me type anything in. I have a screenshot
Hello,
You can upload screenshots using this tool and add the link here.
Meanwhile, please follow our guide here to troubleshoot this issue with your robots.txt:
https://rankmath.com/kb/cant-edit-robots-txt/
Looking forward to helping you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
