Hello,
I apologize for the inconvenience you are facing with the robots.txt configurations on your WordPress Multisite using Rank Math. The information provided by the Rank Math Bot might not fully align with the actual functionality due to the limitations of the multisite setup.
In a WordPress Multisite environment, the robots.txt file can only be modified on the main site of the network. All other sites within the network will inherit the settings from the main site. This means that while you can edit the robots.txt file for the main site, the changes will apply network-wide.
If you try to add an additional Allow line to a specific Multisite, you may encounter an error stating that you cannot do so because the existing robots.txt file will override it. This behavior is due to how Rank Math handles robots.txt in a multisite setup.
To have different robots.txt configurations for each site on your WordPress Multisite network, you would need to manually manage and update the robots.txt file for each individual site outside of Rank Math, as Rank Math’s functionality is limited to the main site.
If you have any further questions or need assistance with managing robots.txt configurations for your WordPress Multisite, please feel free to reach out to our dedicated support team for personalized assistance.
Thank you for bringing this to our attention, and we appreciate your understanding.
Closing spiel
Sources:
What Are the Best Robots.txt File Rules for Multisite? » Rank Math
I asked this questions to the Rank Math bot and got the following answer. However, when I enter an additional Allow line to a specific Multisite, it says I can’t because I have already a robot.txt file which will override it. Seems the Rank Math Bot and the actually doing it are in conflict with each other.
Can I have different Robot.txt configurations for each of my Sites on WordPress Multisite?
Yes, you can have different robots.txt configurations for each of your sites on a WordPress Multisite using Rank Math. Here’s how you can do it:
Install Rank Math on your WordPress Multisite network.
Go to Network Admin → Sites.
Click on the Dashboard tab for the site you want to add robots.txt rules for.
Navigate to Rank Math SEO → General Settings on the site’s dashboard.
Edit the robots.txt file and add the necessary rules specific to that site.
Save your changes before leaving the page.
Repeat these steps for each site on your network where you want to add robots.txt rules.
Please note that the robots.txt file can only be modified on the main site of the network, and all other sites will inherit the settings from the main site due to the limitations of the multisite functionality.
Sources
What Are the Best Robots.txt File Rules for Multisite? » Rank Mat
Sorry about the 3 duplicate posts.
Hello,
Please check your multisite files if there’s a static robots.txt file as Rank Math cannot override it since we create the file virtually/dynamically.
Here’s a guide you can follow as well:
https://rankmath.com/kb/cant-edit-robots-txt/#num-1-presence-of-a-physical-file
Let us know how this goes.
Resolved. The RankBot was right. Each robots.txt needs to be updated manually, outside of Rank Math.
Hello,
Glad that helped.
Please feel free to reach out to us again in case you need any other assistance.
We are here to help.
Thank you.
Hello,
We’re glad that you have already managed to resolve this issue.
If you have any other concerns, please don’t hesitate to contact us anytime so we can assist you further.
Looking forward to helping you.
