IndexNow with WPEngine

#906780
  • Resolved SEW
    Rank Math free

    Hey, I’ve had no problem setting up IndexNow on various websites (mostly hosted on Siteground) and getting them indexed etc but with a website I have on WPEngine even when the API key is uploaded to the root directory, verified, WPEngine support staff confirm everything is worked and visible / not blocked etc I just constantly get 403 errors when I manually submit URLs through RankMaths Instant Indexing feature.

    WPEngine support staff cannot find any issue on their end but considering it works fine with other website hosts I don’t know what else it can.

    Do you have any idea what the issue is here?

Viewing 15 replies - 1 through 15 (of 15 total)
  • Hello,

    We apologize for the issue you are facing with the 403 errors while using IndexNow on your WPEngine-hosted website. It sounds like you’ve already done a thorough job of checking the API key and ensuring that it is accessible.

    The 403 Forbidden error can often occur if the text file containing the API key has not been created automatically or if there are restrictions in place that prevent access to it. Here are a few steps you can take to troubleshoot this issue further:

    1. Check API Key Location: Ensure that the API key is correctly placed in the root directory of your website. You can verify this by clicking on the Check Key button in Rank Math to see if it opens the correct API key location.
      Check API key location

    2. Review IndexNow History: Check the IndexNow History tab in Rank Math’s Instant Indexing settings to see if there are any specific error messages associated with the URLs you are trying to submit. A “200 – OK” response indicates successful submission, while other codes may provide insight into what’s going wrong.
      IndexNow History

    3. Plugin Conflicts: Sometimes, other plugins can interfere with the functionality of Rank Math. Try temporarily disabling other plugins to see if that resolves the issue.

    4. Server Configuration: Since WPEngine has specific configurations, it might be worth asking them to check if there are any server-level rules or security settings that could be blocking the requests from Rank Math.

    If these steps do not resolve the issue, we recommend replying to your ticket, and a human agent from the Rank Math Support team will be able to assist you further.

    Thank you for raising this concern, and we hope to help you get this resolved soon!

    Sources:
    How to Fix 403 Forbidden Error with IndexNow » Rank Math

    Hello,

    Thank you for your query and we are so sorry about the trouble this must have caused.

    Here’s a guide you can follow to fix that issue: https://rankmath.com/kb/fix-403-forbidden-error-indexnow/

    If that doesn’t help, please head over to Rank Math → Instant Indexing → Settings and copy the API key file path from the option “API Key Location” and paste it here so we can check further.

    Looking forward to hearing back from you.

    SEW
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    SEW
    Rank Math free

    I’ve tried everything you suggest in the guide you linked and WPEngine spent 2hrs on live support testing everything on their end and are adamant there’s nothing on there side blocking or effecting it.

    I’ve added the API Key to the sensitive data.

    Hello,

    Just to make sure this is not something with our plugin, please try using the plugin that Bing created for this purpose (https://wordpress.org/plugins/indexnow/) on the website, and if that is also failing, we can be sure it’s not only related to our plugin but with the submission on your website.

    Let us know how it goes. Looking forward to helping you.

    Thank you.

    SEW
    Rank Math free

    Downloaded IndexNow and manually submitted a URL to test and it appears to have submitted successfully.

    However it looks like you can only submit one URL at a time? I was looking to Mass-submit URLs.

    Hello,

    In this case, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.

    Please do take a complete backup of your website before sharing the information with us.

    It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:

    https://wordpress.org/plugins/temporary-login-without-password/

    You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):

    https://wordpress.org/plugins/wp-security-audit-log/

    We really look forward to helping you.

    SEW
    Rank Math free

    Hello,

    I have updated the sensitive data as requested. Can you please check further?

    Thank you.

    Hello,

    We changed the API Key from Rank Math SEO > Instant Indexing > Settings and saved the changes. Then, we tried to submit multiple URLs, and they returned a 202 response.
    https://imgur.com/dpylj3z

    Please check and confirm it also works for you.

    We look forward to hearing back from you.

    Thanks.

    SEW
    Rank Math free

    It’s still not working, check the history tab and see all the 403 errors.

    Initially it would let my submit a small number of URLS to be indexed at a time and would work but a large amount would fail.

    Now even 1 URL brings a 403 error.

    Hello,

    The API key file doesn’t exist in your site’s root directory and that’s why IndexNow is returning a 403 error. Please follow this guide to create a physical file: https://rankmath.com/kb/fix-403-forbidden-error-indexnow/#add-txt-file-manually

    Please do not hesitate to let us know if you need our assistance with anything else.

    SEW
    Rank Math free

    But it DID exist, both myself and WPEngine support confirmed that, so you must have changed it and then decided to delete it once you had it working?

    Either way, I’ve just reuploaded the API key, it’s live and working, but again when I submit URLS they fail.

    Hello,

    The official IndexNow plugin is also returning the same error now.

    It is behaving the same. Some submissions work and then the IndexNow API returns a 403 error. There must be some issue on your site or host’s end. Please check with them again to investigate this further.

    Please do not hesitate to let us know if you need our assistance with anything else.

    SEW
    Rank Math free

    As clearly mentione in my initial post I spent close to 3hrs on support with my host (WPEngine) before initially posting this, they checked absolutely everything on their end and confirmed it was all setup correctly and they do not believe it’s an issue with them.

    They are adamant nothing is blocked or stopping it working and said that with the exact same setup as I have other customers of theirs have successfully set it up without issue.

    So where do we go from here?

    Hello,

    We’re not exactly sure what the issue is here but since it’s happening both in our Instant Indexing implementation as well as the official IndexNow plugin, the issue is most likely coming from your site/server/installation and not an issue specific to Rank Math.

    That said, changing the API (or deactivating and reactivating the IndexNow plugin) does seem to temporarily get it to start working again in both plugins, and I’m not sure how long it lasts before the error starts again but I wouldn’t be surprised if this is cache-related. Have you tried speaking with WP Engine to disable their cache – maybe temporarily, for testing purposes? I had to clear the cache after changing the API for the plugins to start working again.

    Don’t hesitate to let us know if you need help with anything else.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 15 replies - 1 through 15 (of 15 total)

The ticket ‘IndexNow with WPEngine’ is closed to new replies.