Hello,
Thanks for contacting us, and sorry for any inconvenience that might have been caused due to that.
‘hostload exceeded’ is technically the same as ‘crawl rate limit’ exceeded.
Though, usually crawl budget is associated with bigger sites. But note that, small sites can have issues with crawl budget as well.
If you’ve a new site, naturally the crawl budget can be low. But Google should automatically extend the crawl budget for your sites time by time, depending on the demand.
https://developers.google.com/search/docs/crawling-indexing/large-site-managing-crawl-budget#crawl-demand
How do I get more crawl budget?
Google determines the amount of crawling resources to give each site, based on the popularity, user value, uniqueness, and serving capacity. The only ways to increase your crawl budget are to increase your serving capacity for crawls, and (more importantly) to increase the value of the content on your site to searchers.
There’s also a possibility that, you might encounter server errors during a live test that won’t occur during crawling or, conversely, your live test might succeed when a server error might have occurred during crawling, since server errors can be transient.
In this case, you may try checking what the current crawl limit is via the settings page:
https://support.google.com/webmasters/answer/48620?hl=en
If there’s a low limit set there, you may try increasing it to see if that works for you.
If the issue persists, I’d suggest you get in touch with your hosting provider as well.
Hope that helps, and please do not hesitate to let us know if you need our assistance with anything else.
Thank you.
