Hello,
Let us know how that goes.
Please don’t hesitate to get in touch in case you need any other assistance.
Thanks.
hi
i got reply from WP-Optimiz
Hi,
The advice you have received from Rank Math SEO does not really make sense, given your question.
WP-Optimize asks WordPress to add the Disallow line at the end of robots.txt. But that is all it does. It does not directly manage robots.txt itself. It does not read or write to the file. It uses the robots_txt hook – https://developer.wordpress.org/reference/hooks/robots_txt/ – to tell WP core about an extra line. So it sounds like Rank Math SEO don’t really understand that hook. You should point them to that link and tell them to looks at the robots_txt in wp-optimize.php, so that they can see that this cannot be related to your problem.
Thank you,
David
Hello,
Since they are asking to add the Disallow, the rule is being added to your robots.txt file. You can edit and make changes to your file but the line will always be added as they are adding it at the end.
So there is no issue with making changes to your robots.txt file. You should ask them to provide a fix to prevent that rule from being added to your robots.txt file.
Hope this clarifies your doubts. Let us know if you need any other assistance.
Harshad (@bornforphp)
1 hour, 19 minutes ago
@studentsaver This is not a WP-Optimize issue as @davidanderson said WP-Optimize asks WordPress to add the Disallow line at the end of robots.txt. But that is all it does. It does not directly manage robots.txt itself. It does not read or write to the file. It uses the robots_txt hook – https://developer.wordpress.org/reference/hooks/robots_txt/
Hello,
You can still edit and use the robots.txt file. The rule they are adding doesn’t affect the functionality of robots.txt.
I will also check with our dev team if there is something we can do to fix this from our side.
Hope this helps. Let us know if you need any other assistance.
Thanks.
Hello,
Unfortunately, there’s nothing we can do from our side since they are hooking to a default filter from WordPress and adding the necessary code at the bottom of it.
To remove this it would require a code change from their side on how they include that line in the robots.txt file.
Don’t hesitate to get in touch if you have any other questions.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
