my Robots.txt file is NOT writable

Hello,

We apologize for the issue you are facing with your robots.txt file being not writable. This error typically occurs when Rank Math cannot modify your robots.txt file due to certain restrictions. Here are some common reasons and solutions:

1. Presence of a Physical File

If there is a physical robots.txt file in the root folder of your website, it can prevent Rank Math from editing it. You can remove this file via FTP or cPanel File Manager and then try to edit the robots.txt file through Rank Math.

2. Permission Issues

If there are permission issues on your web server, you may need to contact your web host for assistance.

3. wp-config.php Settings

You may also need to check your wp-config.php file for the following line:

define ('DISALLOW_FILE_EDIT', true);

If it exists, change it to:

define ('DISALLOW_FILE_EDIT', false);

If it does not exist, you can add it as shown above. This will allow Rank Math to edit the robots.txt file.

4. Adding a Filter

To enable editing, you can add the following filter to your site:

/**
 * Allow editing the robots.txt & htaccess data.
 *
 * @param bool Can edit the robots & htacess data.
 */
add_filter( 'rank_math/can_edit_file', '__return_true' );

You can refer to this guide on adding filters to your site.

Crawling Issues

Regarding the crawling issues with your website pages and posts, it’s essential to ensure that your robots.txt file is correctly configured to allow search engines to crawl your content. Once you resolve the writable issue, you can adjust the Allow and Disallow rules as needed.

Video Tutorial

Unfortunately, I don’t have a specific video tutorial link for the Business package configurations at this moment. However, you can find various resources and guides on our knowledgebase that may help you with configurations.

Improving SEO Configurations

To improve your website’s ranking, consider the following tips:

• Ensure all your pages have unique and optimized titles and meta descriptions.
• Use relevant keywords throughout your content without keyword stuffing.
• Optimize images with alt text and proper file names.
• Regularly update your content and ensure it provides value to users.
• Utilize internal linking to connect related content on your site.
• Monitor your website’s performance using tools like Google Search Console.

If you still have questions or need further assistance, please feel free to reply to this ticket, and a human agent from our support team will assist you further.

Thank you for raising this concern!

Sources:
I Can’t Edit My Website’s Robots.txt » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math