indexing

Hello,

Thank you for contacting the support, and sorry for any inconvenience that might have been caused due to that.

I checked your website and it seems there’s lacking in the configuration of your robots.txt file.

Please refer to the standard configuration that Rank Math usually use:

User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://dailydogdrama.com/sitemap_index.xml

You can edit the robots.txt file with Rank Math by going to Rank Math > General settings > Edit Robots.txt

Here is a guide for your reference:
https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

After that, please follow the steps below:

1. Flush the Sitemap cache by following this video screencast:
https://i.rankmath.com/pipRDp

2. Exclude the Sitemap files of the Rank Math plugin in your caching plugin. The cache could be via a plugin or from the server. For plugins or Cloudflare, please follow this article:
https://rankmath.com/kb/exclude-sitemaps-from-caching/

3. After that, remove all your sitemaps from your GSC and resubmit only the primary sitemap (sitemap_index.xml).

Let us know how that goes. Looking forward to helping you with this one.

Hello,

Please head over to your FTP and locate the directory of your website. Example: “public_html/”.

Then, find a file named “robots.txt” and delete it. Rank Math should be able to generate its own standard robots.txt configuration after you deleted it.

Let us know how that goes.

Looking forward to helping you.

Hello,

I did check your robots.txt file and I only saw this configuration:

You may try to use the configuration I shared in my previous reply as this is the default configuration Rank Math generates for effective search engine crawling.

User-Agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://dailydogdrama.com/sitemap_index.xml

If you still can’t modify the robots.txt through Rank Math’s robots.txt editor, we might need to take a closer look at your WordPress admin dashboard and FTP.

Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

Please do take a complete backup of your website before sharing the information with us.

It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

https://wordpress.org/plugins/temporary-login-without-password/

You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

https://wordpress.org/plugins/wp-security-audit-log/

We really look forward to helping you.

Hello,

In this case, you may need to give Google some time and they should be indexed eventually since you have recently fixed the robots.txt issue.

If Google still isn’t indexing your page, it means that either Google hasn’t crawled your page yet because it hasn’t allocated that much crawl budget to your website.

Unfortunately, there’s no definite time for Google to recrawl your site. According to Googe guidelines, crawling can take anywhere from a few days to a few weeks.

Here’s a link for more information:
https://developers.google.com/search/docs/advanced/crawling/ask-google-to-recrawl

I hope that helps.

Thank you.

Hello,

It seems like you still have the HTTP variant of your website active and it’s being indexed by Google.

You should definitely make a redirection to the HTTPS version of your website and make sure the property on GSC reflects the same and is for the correct variant.

We also recommend that you make a redirection on your server to direct all traffic to the secure version of the website.

Don’t hesitate to get in touch if you have any other questions.