Thousands of pages are not being crawled

#85369
  • Resolved Our DFW
    Rank Math free

    When looking at my sitemap, I noticed that thousands of pages are missing. Can you let me know what I need to do to get my other pages crawled?

Viewing 10 replies - 1 through 10 (of 10 total)
  • Hello,

    Thank you for contacting Rank Math and sorry for any inconvenience that might have been caused due to that.

    Please exclude your sitemap URLs from being cached and clear your cache then do the following:

    1. Head over to WordPress Dashboard > Settings > Permalinks

    Hit the save button once.

    2. Go to WordPress Dashboard > Rank Math > Sitemap Settings and change the links per sitemap value to a different value such as 501 or 1001.

    Hit the save button once.

    That should fix the issue. You can test your sitemap in a private browser to avoid browser cache

    If it doesn’t, please do let us know so we can look at this further.

    How do I do this:

    “Please exclude your sitemap URLs from being cached and clear your cache.”

    Hello,

    If you don’t have a caching plugin or server caching enabled then this should not worry you.

    Please check to confirm you have enabled the post type sitemap in Rank math > Sitemap Settings.

    If this doesn’t help, then we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WP logins in the designated Sensitive Data section.
    Sensitive Data Section

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Looks like everything is enabled on my end. I have added my login, can you please review?

    Alberto
    Rank Math business

    Hello,

    I have checked on your site and you have a lot of outdated plugins. Could you update them? Since outdated plugins can potentially generate conflicts so we would like to discard that case.

    Looking forward to help you.

    Can you please check again, my plugins are up to date

    • This reply was modified 3 years, 6 months ago by Our DFW.

    Hello,

    You had removed Rank math from your site. I installed and activated it and the sitemap is generated with the 224 pages you have published.

    I have currently reverted Rank Math to deactivated, you can enable it and check this. Let us know how it goes.

    Looking forward to helping you. Thank you.

    ​​​​​​

    Michael,

    Can you please look at the Sensitive Data area. I’m referring to the URL I posted in that area. That link in the Sensitive Data area has thousands of real estate listings that update every 30 minutes. How do I get the listings on that page to be crawled?

    Hello,

    Sorry for not following up quickly and any inconvenience that might have been caused due to that.

    Can you please?
    1. Confirm if that CPT is added by the following plugin?
    Listing, Classified Ads & Business Directory – uListing

    2. Please update all your themes & plugins to the latest version.

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 10 replies - 1 through 10 (of 10 total)

The ticket ‘Thousands of pages are not being crawled’ is closed to new replies.