Robot.txt İssue

#146879
  • Resolved Ada Creative

    4 years, 1 month ago

    Rank Math free

    Could you please help me ? I have problem robot.txt file. Semrush said robot.txt file has format error.
    I used RankMath for create sitemap.xml .What could be the reason for this?
    My robot.txt file as follow ;

    User-Agent: *
    Disallow: /wp-admin/
    Disallow: /wp-login.php?$
    Disallow: /?s=
    Disallow: /search/
    Disallow: /cgi-bin
    Disallow: /wp-includes
    Disallow: /author/

    User-agent: Baiduspider
    Disallow: /
    Allow: /wp-admin/admin-ajax.php

    Sitemap :https://dunyaambulans.com.tr/sitemap_index.xml

Viewing 1 replies (of 1 total)
  • Danial

    4 years, 1 month ago

    Rank Math business

    Hello,

    Thank you for contacting Rank Math, and sorry for any inconvenience caused.

    I checked your robots.txt using a 3rd party tool, and it shows that your robotx.txt has no issues.
    https://i.rankmath.com/SgbDsh

    You should set only the sitemap_index.xml for your sitemap and remove the rest as sitemap_index.xml already has the other links of the sitemap.

    I hope this helps you with your issue.

Viewing 1 replies (of 1 total)

You must be logged in to reply to this ticket.