-
I had set up a custom text before and after the feed that it’s not showing.
I am unsure if it’s worth fixing or removing the feed.
What is the benefit of having a feed vs not having a feed?
I have disallowed it in the robots.txt file however, it Is waisting crawling budget without any benefit
-
Hello,
We apologize for the issue you are facing with the custom text not showing before and after the feed. Regarding your question about the benefits of having a feed versus not having one, here are some points to consider:
Benefits of Having a Feed:
- Content Distribution: Feeds allow your content to be distributed to various platforms and services, which can help increase visibility and traffic to your site.
- SEO Benefits: Having a feed can improve your site’s SEO by allowing search engines to discover and index your content more efficiently.
- User Engagement: Feeds can enhance user engagement by providing users with easy access to updates and new content.
- Integration with Other Services: Many applications and services rely on feeds to pull in content, which can be beneficial for marketing and outreach.
Considerations for Disallowing in robots.txt:
If you have disallowed the feed in your robots.txt file, it means that search engines will not crawl it, which could lead to wasted crawling budget if the feed is not providing any value. If you believe that the feed is not beneficial for your site, you might consider removing it altogether.
To address the issue of the custom text not showing, you may want to check if there are any settings or configurations within your feed setup that need adjustment. If you need further assistance with this, please reply to this ticket, and a human agent from the Rank Math Support team will take over and help you resolve the issue.
Thank you for raising this concern!
Sources:
How to Fix the "Indexed, though blocked by robots.txt" Error » Rank Math
Common robots.txt Issues & How to Fix Them » Rank Math
How to Fix ‘Page Indexed Without Content’ Issue in Google Search Console » Rank MathHello,
I have updated the sensitive data as requested. Can you please check further?
What I see in GSC is the following
Crawled – currently not indexed
The page was crawled by Google but not indexed. It may or may not be indexed in the future; no need to resubmit this URL for crawling.Hello,
Those URLs are usually triggered by backup plugins such as UpDraft backups or All-In-One WP Migration.
Here’s a guideline and see if that works for you:
https://obrienmedia.co.uk/help/why-is-doing_wp_cron-being-added-to-my-urlsIf you don’t want Google to crawl those URLs, then you can add a disallow rule to your robots.txt:
Disallow: *doing_wp_cron=*
Looking forward to helping you.
I have the same issue with feed and ?doing_wp_cron
in the WP-config I have
define( 'DISABLE_WP_CRON', true )
 because I use server cron.
in the robots.txt I have
Disallow: */feed/*
It doesn’t helpHello,
The disable WP Cron rule is not going to prevent Google from discovering and crawling the URLs with the doing_wp_cron parameter. To prevent this, you should add the rule suggested by my colleague to your site’s robots.txt file.
Please do not hesitate to let us know if you need our assistance with anything else.
Disable WP Cron rule because I don’t use wp-cron I use server cron.
I will ask server support about that.
My concern is about the crawling budget because I have 1740 of these cron URLs and 345 articlesYou didn’t answer my question about feed:
I had set up a custom text before and after the feed that it’s not showing.
I am unsure if it’s worth fixing or removing the feed.I have another issue, this happens for the second time.
I changed my robots.txt file as recommended
https://example.com/robots.txt?123
adding
Disallow: *doing_wp_cron=*However, rank math does not allow me to see the real robots.txt file in the root only inside Rankmath.
How can I disable rank math robots.txt???
Thanks
I had to save the robots.txt file inside the rankmath to update the file.
Please let me know if there is a way to disable this rankmath feature since I always update the robots.txt by FTP and this feature is interfering.Hello,
Rank Math only generates a robots.txt for your site dynamically when there is no static robots.txt file in the root directory.
If an actual robots.txt file is present in the root folder of your site, Rank Math won’t generate it.
Create a robots.txt file in your root folder to use a static file.
We hope this helps. Please let us know if you have further questions or concerns.
Thank you.
I have always had a robots.txt file in the root folder of the site, as explained before.
I downloaded the file by FTP changed the file and uploaded again. However, when I try to see the file in the browser it shows me the old file.Since I have this issue with rankmath I have to upload the file by FTP but I have to save it inside rankmath
.
I have never used the robots.txt inside Rankmath before, and I am asking how to disable it because Rankmath is interfering with the real robots.txt fileHello,
In this case, we might need to take a closer look at the settings. Please edit the first post on this ticket and include your WordPress & FTP logins in the designated Sensitive Data section.
Please do take a complete backup of your website before sharing the information with us.
It is completely secure and only our support staff has access to that section. If you want, you can use the below plugin to generate a temporary login URL to your website and share that with us instead:
https://wordpress.org/plugins/temporary-login-without-password/
You can use the above plugin in conjunction with the WP Security Audit Log to monitor what changes our staff might make on your website (if any):
https://wordpress.org/plugins/wp-security-audit-log/
We really look forward to helping you.
Sorry, for the delay I am on the road, I migrated from Cloudflare to xCloud.
This issue has happened since I migrated.
I don’t have a backup yet, I will come back when I begin to work regularly thanksHello,
Please keep us updated on your progress. We eagerly await your response.
To ensure you have ample time and support, we’ll keep this support ticket open until your issue is fully resolved.
Please don’t hesitate to get in touch if you have any other questions.
Thank you.
Hello,
Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.
If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.
Thank you.
The ticket ‘Custom text before and after feed not showing’ is closed to new replies.