How can I solve my site Indexing issues - Support

Resolved Gabriel Ojeh
5 months, 1 week ago

Rank Math free

Hello support team,

I actually discouraged search engine from indexing my site because I was still working on it but now I’m done with my site and I unchecked the box(discourage search engine) but my site isn’t still showing on Serp for like 2days now.

And so i typed this: https://smarttechvilla.com/robots.txt and from what I can see, it showing Disallow: /wp-admin/.

What do I do to make it start showing on Serp?

Thank you.

Viewing 15 replies - 1 through 15 (of 16 total)

1 2 →

RankBot
5 months, 1 week ago

Hello,

We apologize for the inconvenience you are facing with your site’s indexing. It’s great that you’ve unchecked the “Discourage search engines” option in your WordPress settings.

Regarding the robots.txt file, the “Disallow: /wp-admin/” directive is preventing Google from crawling your wp-admin directory. This could be a reason why your site isn’t showing up in the SERPs.

To resolve this issue, you can edit your robots.txt file using Rank Math. You can do this by navigating to WordPress Dashboard → Rank Math SEO → General Settings → Edit Robots.txt and remove the “Disallow: /wp-admin/” directive.

Here’s a screenshot to guide you:

After making this change, it may take some time for Google to recrawl your site and index it properly. If you have any further questions or need assistance, please feel free to reach out to us.

Thank you for bringing this to our attention.

Sources:
Why Google Hasn’t Indexed Your Post, Page, and/or Website? » Rank Math
Discovered – Currently Not Indexed in Google Search Console » Rank Math
How to Fix ‘Page Indexed Without Content’ Issue in Google Search Console » Rank Math
Why Did My Website Disappear From Google Search? » Rank Math

Gabriel Ojeh
5 months, 1 week ago

Rank Math free

Okay, Thank you so much, I appreciate.

But I don’t know how to edit and also what would I insert in the txt box?

Jhon L
5 months, 1 week ago

Rank Math free

If your site is having trouble getting indexed, there are a few things you can do to sort it out. First off, check your robots.txt file – it might be blocking search engines from checking out your important pages. Make sure there’s no meta tag or HTTP header telling search engines to keep their hands off your content. Submit a sitemap to Google Search Console – it’s like giving search engines a roadmap to your site. Take a look at your site for any crawl errors that might be throwing a wrench in the works. Keep your content fresh and relevant, ’cause search engines love that stuff. And if you’ve just launched your site, give it a bit of time – indexing doesn’t happen overnight.

Rakibuzzaman Siam
5 months ago

Hello,

We’ve checked your homage but couldn’t find any issue that may prevent this from being indexed on Google:

In this case, please check your Google Search Console coverage section to determine any issues reported on your site: https://support.artlogic.net/hc/en-gb/articles/360016851260-Google-Search-Console-errors-and-coverage-issues

You can share the error message or take a screenshot using this tool and add the link here so we can check as well.

However, please note that it is completely normal for newly published posts/pages/websites to take time before they get crawled or indexed by Google. It depends on a lot of factors. Your posting frequency + the domain authority are just two of the many factors Google considers when indexing some new URLs.

Google assigns a crawl budget to your website depending on these factors (especially these two) and that has a direct effect on how soon or how late your content can get indexed.

Here’s a link for more information:
https://rankmath.com/kb/google-index/

Regarding the Disallow: /wp-admin/ rule on your robots.txt file, it is absolutely fine and you don’t have to worry about this. If you don’t disallow the /wp-admin/, Google will start crawling your admin pages which will waste your crawling budget.

Let us know how it goes. Looking forward to helping you.

Thank you.

Gabriel Ojeh
5 months ago

Rank Math free

Alright, Thank you.

I checked my search console and figured out that it was still showing my old logo(I used a logo before but I later changed my site logo) but my search console isn’t showing my new logo and I decided to create a new search console account adding “WWW” to it but the first search console account is https://smarttechvilla.com while the new one is https://www.smarttechvilla.com and it’s showing the new logo.

Although I just created the search console account today, I haven’t done any configuration for it.

Secondly, if I search my site on SERP, it shows like this, but still using the old logo and a deleted category:

Lastly, the first search console doesn’t have a coverage section, it only has pages, sitemaps, and removals:

while the new one is still processing:

Gabriel Ojeh
5 months ago

Rank Math free

I think the images didn’t load correctly.

Here is the edit.

Alright, Thank you.

I checked my search console and figured out that it was still showing my old logo(I used a logo before but I later changed my site logo) but my search console isn’t showing my new logo and I decided to create a new search console account adding “WWW” to it but the first search console account is “https://smarttechvilla.com” while the new one is “https://www.smarttechvilla.com” and it’s showing the new logo.: Double Google Console

Although I just created the search console account today, I haven’t done any configuration for it.

Secondly, if I search my site on SERP, it shows like this, but still using the old logo and a deleted category: How it shows on serp

Lastly, the first search console doesn’t have a coverage section, it only has pages, sitemaps, and removals: First search console has no coverage section

while the new one is still processing: New Console still processing: New Console Processing

Rakibuzzaman Siam
5 months ago

Hello,

We deeply apologize for the unexpected delay in response. Your previous reply seems to have been stuck in our drafts section for some reason.

It looks like you’re running your website on the non-www version. In this case, we suggest you verify the correct version of your website on Google Search Console. Also, please test your homepage in the URL Inspection Tool and share the full screenshot of the result with us so that we can check the issue further for you: https://support.google.com/webmasters/answer/9012289?hl=en

Regarding the logo and pages on SERPS, it seems like Google hasn’t crawled your website recently. We’ve checked one of your pages from SERPs, and you can see Google last crawled and cached this page on 10 Oct 2023:

In such a case, you can manually submit the URLs using the GSC URL inspection tool and see if that works for you: https://support.google.com/webmasters/answer/9012289?hl=en

Also, please make sure, you’ve properly submitted your sitemap on Google Search Console: https://rankmath.com/kb/submit-sitemap-to-google/

Let us know how it goes. Looking forward to helping you.

Thank you.

Gabriel Ojeh
5 months ago

Rank Math free

EDIT:

I later tried requesting indexing and it showed this: https://imgur.com/WfcJux4

Miguel
4 months, 4 weeks ago

Hello,

Your homepage is returning a soft 404 error. That usually means that the page is accessible but there are indications on the page that it is indeed a 404 page that doesn’t exist.

Looking at the page it seems like it’s currently empty and there’s a message saying “Nothing found” on it so that’s why Google is reporting the soft 404.

When you have real content on it the crawling from Google should be fine.

Don’t hesitate to get in touch if you have any other questions.

Gabriel Ojeh
4 months, 4 weeks ago

Rank Math free

Alright, so what you are saying in essence is that the website is good to go and the soft 404 is due to the website not having any content and all I just need to do now is to start creating content, right?

If Yes, then no problem, I would do have you have said.

My last question is this: When I got my website up and running and downloaded a theme to it. The theme had some demo content on it and my site was showing perfectly on SERP but because I was still working on it and i discouraged SEARCH ENGINES from indexing the site. After I did that, I deleted all the demo articles and later encouraged SEARCH ENGINES to index my site but ever since then it hasn’t been showing perfectly on Serp, all I see is this: https://imgur.com/uTPuE11

So does that mean that once I start creating content, all will be resolved even with the way it’s being shown on Serp?

Jeremy
4 months, 3 weeks ago

Hello,

Alright, so what you are saying in essence is that the website is good to go and the soft 404 is due to the website not having any content and all I just need to do now is to start creating content, right?

You are correct, the soft 404 indicates that your page doesn’t contain much content so the solution here is to simply add the content.

As for your last question, you mentioned that your site is live at first so Google may have crawled and indexed your site at the very beginning. To fix this issue, you need to update the content and allow Google to crawl your website.

Please note that since your website is fairly new, it may take some time for Google to crawl your updated content so all you have to do is wait while you build your content.

Looking forward to helping you.

Magch Info
4 months, 3 weeks ago

Rank Math free

Hi everyone this is my client website on cloud shoes. am also getting indexing issue and one main this is that sitemap is not working website.

Gabriel Ojeh
4 months, 3 weeks ago

Rank Math free

Hi Magch,

Although I don’t know much about indexing and I’m just someone who was trying to get my site indexed which has been resolved.

First of all, you should check if you really setup the plugin well, use this guide to check if you did set it up correctly: https://rankmath.com/kb/how-to-setup/

Secondly: Check your sitemap to know if you didn’t disallow search engines from indexing your site.

Thirdly: Go to your admin dashboard > Click Settings > Hover to Reading > Scroll down and check if you didn’t discourage search engines from indexing the site.

Magch Info
4 months, 3 weeks ago

Rank Math free

i have check my all setting is ok

Gabriel Ojeh
4 months, 3 weeks ago

Rank Math free

Okay at Magch.

Use this url to check if your site is index – site:https://(Your domain name).com to see if your site has been indexed. If you can see the site, then it means it has been indexed.

Just know that Google sometimes takes time to re-index a new site, Sometimes it takes days or even weeks.

RankBot
3 months, 3 weeks ago

Hello,

Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

Thank you.