problem

#216266
  • Resolved ahmad rahhal
    Rank Math free

    hi i use rankmath pro but i have a problem
    in my site tsf7.com when i go to ahref.com i see that my categories is non index but i open the categories in site map why my categories is non index??
    and i have another quistion when i go to general setting and then edit robot i see this
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /tmp/
    Disallow: /~joe/
    what this is mean??
    and when i put my site in google console i put my site in domain not in url prefix its is problem? or same? because when i go to robot file in console i cant go in the robot file its only for the prefix url not include in domain
    please help me

Viewing 15 replies - 1 through 15 (of 19 total)
  • and when i go in 404 monitor i see many site but im surprised becuase my site only have one article and categories why all this site is 404 eroor?
    wp-login
    Redirect | Delete
    12 2021-06-21 08:41:33
    apple-touch-icon-precomposed.png
    Redirect | Delete
    3 2021-06-21 08:40:31
    apple-touch-icon.png
    Redirect | Delete
    3 2021-06-21 08:40:31
    https://tsf7.com
    Redirect | Delete
    57 2021-06-21 07:57:44
    ahrefs_648ecb3da73b5a740af5889ed37dbb9aa89fb17d281c01782f8e2d241e618868
    Redirect | Delete
    7 2021-06-20 19:30:10
    ads.txt
    Redirect | Delete
    8 2021-06-20 17:43:29
    sitemap-index.xml
    Redirect | Delete
    1 2021-06-20 14:17:51
    sitemap-index-.ml
    Redirect | Delete
    1 2021-06-20 14:17:44
    sitemap-index-xml
    Redirect | Delete
    1 2021-06-20 14:17:37
    cp/1.html
    Redirect | Delete
    2 2021-06-20 14:15:54
    tsf7.com
    Redirect | Delete
    1 2021-06-20 06:59:00
    islamic/quran/chosen
    Redirect | Delete
    1 2021-06-17 09:53:24
    aaa9
    Redirect | Delete
    14 2021-06-17 09:05:58
    wp/wp-admin/setup-config.php
    Redirect | Delete
    5 2021-06-17 05:57:42
    wordpress/wp-admin/setup-config.php
    Redirect | Delete
    5 2021-06-17 05:57:32
    humans.txt
    Redirect | Delete
    2 2021-06-16 11:10:50
    wp-content/themes/boxnews/assets/css/bootstrap.rtl.min.css.map
    Redirect | Delete
    2 2021-06-13 17:59:08
    local-sitemap.xml
    Redirect | Delete
    5 2021-06-13 04:26:32
    archivarix.cms.php
    Redirect | Delete
    1 2021-06-12 12:29:14
    sitemap
    Redirect | Delete
    1 2021-06-11 10:46:24
    index_anhui.html
    Redirect | Delete
    1 2021-06-11 10:18:11
    oldsite/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:24
    site/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:23
    BACKUP/wp-admin/install.php
    Redirect | Delete
    3 2021-06-10 12:40:21
    web/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:20
    cms/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:19
    blog/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:18
    test/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:16
    wordpress/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:15
    old/wp-admin/install.php
    Redirect | Delete
    3 2021-06-10 12:40:13
    new/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:12
    wp/wp-admin/install.php
    Redirect | Delete
    2 2021-06-10 12:40:10
    test
    Redirect | Delete
    4 2021-06-10 05:09:12
    backup
    Redirect | Delete
    12 2021-06-10 05:09:09
    demo
    Redirect | Delete
    4 2021-06-10 05:08:58
    old
    Redirect | Delete
    7 2021-06-10 05:08:57
    new
    Redirect | Delete
    4 2021-06-10 05:08:54
    blog
    Redirect | Delete
    4 2021-06-10 05:08:36
    tsf7
    Redirect | Delete
    8 2021-06-10 05:08:19
    wordpress
    Redirect | Delete
    12 2021-06-10 05:08:13
    wp
    Redirect | Delete
    8 2021-06-10 05:08:03
    new/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:27
    blog_old/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:22
    demo-wp/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:18
    demo/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:12
    blog/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:09
    wp-old/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:05
    old/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:50:01
    cms/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:49:50
    app/wp-admin/setup-config.php
    Redirect | Delete
    4 2021-06-10 02:49:46
    site
    Redirect | Delete
    3 2021-06-10 01:54:00
    2019
    Redirect | Delete
    3 2021-06-10 01:53:51
    2020
    Redirect | Delete
    3 2021-06-10 01:53:26
    home
    Redirect | Delete
    3 2021-06-10 01:53:02
    sitemap_index.xml
    Redirect | Delete
    5 2021-06-09 22:08:17
    google00b8995840fa182d.html
    Redirect | Delete
    2 2021-06-09 17:40:57
    google6088cd35038c1e45.html
    Redirect | Delete
    2 2021-06-09 17:40:57
    demo/wp-admin/install.php
    Redirect | Delete
    1 2021-06-08 23:18:36
    up/wp-admin/install.php
    Redirect | Delete
    1 2021-06-08 23:18:19
    api/v1/ug/systems/init/5
    Redirect | Delete
    1 2021-06-08 20:06:25
    .env
    Redirect | Delete
    1 2021-06-08 01:30:25
    apple-touch-icon-120×120-precomposed.png
    Redirect | Delete
    1 2021-06-07 23:49:39
    apple-touch-icon-120×120.png

    and google console there is 2 link include in 404 monitor link
    http://www.tsf7.com/index_anhui.html
    11‏/06‏/2021
    http://www.tsf7.com/cp/1.html

    Hello,

    Thank you for contacting Rank Math and bringing your concern to our attention. I’m sorry for any inconvenience this issue may have caused you.

    I’ve checked your category sitemap, and it is containing 59 URLs. Could you please confirm if this is the correct count? If a URL is in the sitemap, it means that they are already set to index.

    For your robots.txt, that is not the default robots.txt that Rank Math generates. If you want Rank Math’s default robots.txt, please delete any static robots.txt file in your website’s root directory.
    Here’s our default robots.txt looks like:
    https://rankmath.com/kb/how-to-edit-robots-txt-with-rank-math/

    I hope that helps.

    Thank you, and please don’t hesitate to contact us anytime if you need further assistance with anything else.

    Hello,

    For the 404s, please note that we only report the 404s. We do not have information on how or why they are generated. You can get further insight into them by enabling the advanced monitor at WordPress Dashboard > Rank Math > General Settings > 404 Monitor:
    https://rankmath.com/kb/monitor-404-errors/#advanced-404-monitor

    That will give you more information like referrer and user-agent. You can use that information to track down the source or find out if it is just bots generating those errors.

    You can also fix these errors by redirecting them to a related page on your website:
    https://rankmath.com/kb/fix-404-errors/

    Or, you can add them to the exclusion list at WordPress Dashboard > Rank Math > General Settings > 404 Monitor > Exclude Paths

    I hope that helps.

    Thank you

    thanks for first problem
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /tmp/
    Disallow: /~joe/
    what this is mean??
    and its true or not???
    and whay in google console because i add my site in domain not in prefix there is no robot file in google console????

    Anas
    Rank Math business

    Hello,

    You do not need to add the robots.txt file in the Search Console.

    Disallow: /cgi-bin/
    Disallow: /tmp/
    Disallow: /~joe/ means that you are not allowing these 3 directories to be crawled by the robots.

    You must add the below rules to your robots.txt file:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://yourdomain.com/sitemap_index.xml

    You can edit the robots.txt file with Rank Math by going to Rank Math > General Settings > Edit robots.txt

    I hope this helps. Looking forward to helping you.

    ok i must delete this Disallow: /cgi-bin/
    Disallow: /tmp/
    Disallow: /~joe/

    and put this

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://yourdomain.com/sitemap_index.xml ?????
    and i have to remove the file from server because the file details in my serverr is Disallow: /cgi-bin/
    Disallow: /tmp/
    Disallow: /~joe/

    Hello,

    Thank you for the follow-up.

    If you delete the robots.txt file in your website’s root directory/server, Rank Math will automatically generate your robots.txt virtually which contains

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php
    Sitemap: https://yourdomain.com/sitemap_index.xml

    I hope that helps.

    Thank you.

    ok and if i dont deleted and edit the robot txt from rank math in this case i have to remove the root file or not from my server??
    please more details for this case because this case is sensitive

    Ankit
    Rank Math business

    Hello,

    Thank you for your reply.

    You will not be able to edit the file from Rank Math because Rank Math generates the virtual robots.txt file for your website. You can delete the physical file from your root directory, and later, you can define your own rules if you want inside the robots.txt by heading over to Rank Math > General Settings > Edit Robots.txt

    Looking forward to helping you. Thank you.

    for the 404 problem i have more than 63 404monitor link
    some of them wrong link
    and some of them its go in google console as 404 page
    what i can do?? to fix them
    i read the videos and all rank math tuturial but i dont know what i should do
    i need more detailes please with out any link to go i see all links that talk about this case

    Ankit
    Rank Math business

    Hello,

    Thank you for your reply.

    For the 404 links, first, you have to decide whether you want to redirect them to the homepage or not, check if you had a page previously with that slug, and suddenly you are getting those errors you may need to find out a post that matches with your slug and check if the link is working? When you get those errors, did you make any changes to the permalink structure and forgot to make the redirection rule.

    I hope that sheds some light, Thank you, and looking forward to your update.

    my site dont have any article only one article how my site have 63 error and my site with out any article only one article
    tsf7.com my site check to believe me
    there is only 2 link go to console as 404 error
    the first is index_anhui.html
    and the second is cp/1.html
    the others not come to console and this is the others
    https://tsf7.com
    wp-login
    apple-touch-icon-precomposed.png
    apple-touch-icon.png
    ahrefs_648ecb3da73b5a740af5889ed37dbb9aa89fb17d281c01782f8e2d241e618868
    ads.txt
    sitemap-index.xml
    sitemap-index-.ml
    sitemap-index-xml
    tsf7.com
    islamic/quran/chosen
    aaa9
    wp/wp-admin/setup-config.php
    wordpress/wp-admin/setup-config.php
    humans.txt
    wp-content/themes/boxnews/assets/css/bootstrap.rtl.min.css.map
    local-sitemap.xml
    archivarix.cms.php
    sitemap
    oldsite/wp-admin/install.php
    site/wp-admin/install.php
    BACKUP/wp-admin/install.php
    web/wp-admin/install.php
    cms/wp-admin/install.php
    blog/wp-admin/install.php
    test/wp-admin/install.php
    wordpress/wp-admin/install.php
    old/wp-admin/install.php
    new/wp-admin/install.php
    wp/wp-admin/install.php
    testbackup
    demo
    oldnew
    blog
    tsf7wordpress
    wpnew/wp-admin/setup-config.php
    blog_old/wp-admin/setup-config.php
    demo-wp/wp-admin/setup-config.php
    demo/wp-admin/setup-config.php
    blog/wp-admin/setup-config.php
    wp-old/wp-admin/setup-config.php
    old/wp-admin/setup-config.php
    cms/wp-admin/setup-config.php
    app/wp-admin/setup-config.php
    site
    2019
    2020
    home
    sitemap_index.xml
    google00b8995840fa182d.html
    google6088cd35038c1e45.html
    demo/wp-admin/install.php
    up/wp-admin/install.php
    api/v1/ug/systems/init/5
    env
    apple-touch-icon-120×120-precomposed.png
    apple-touch-icon-120×120.png

    seee all this its look like spam see all my 63 error please see it

    Ankit
    Rank Math business

    Hello,

    Thank you for your reply.

    Those look like very old URLs even before setting up your WordPress site. Do you remember any of that directory/file you have created before? If you have an analytics tracker setup, see for the possible referral source?

    Looking forward to helping you.

    my site is new i buy ot before 2 weak only
    some of this link like png image
    and some of this link i put this link by error like wp-admin
    but there is very link i dont know why its become to 404 monitor!!!
    specially the 2 link that go to google console
    please help mee im so sad for this problem

    Ankit
    Rank Math business

    Hello,

    Thank you for your reply.

    There might be a possibility of the old links that must be on the other websites. Did you check the referral source in google analytics? It will definitely shed some light.

    Please follow the guide below to find the source of 404 errors:
    https://rankmath.com/kb/find-the-souce-of-404-errors/

    Looking forward to helping you.

    Hello,

    Since we did not hear back from you for 15 days, we are assuming that you found the solution. We are closing this support ticket.

    If you still need assistance or any other help, please feel free to open a new support ticket, and we will be more than happy to assist.

    Thank you.

Viewing 15 replies - 1 through 15 (of 19 total)

The ticket ‘problem’ is closed to new replies.