RankEcho

SEO tool crawler

What is AhrefsBot?

AhrefsBot crawls the web to build the link and page index behind Ahrefs' SEO tools. Blocking AhrefsBot keeps your pages and links out of Ahrefs' fresh data, so Ahrefs users see less about your site.

Operator
Ahrefs
What it does
Builds an SEO tool's index
robots.txt token
AhrefsBot
Verified on rankecho.io, 30 days
3,586 requests

What AhrefsBot did on rankecho.io

From 17 October to 15 November 2026, Cloudflare verified 3,586 requests from AhrefsBot, on 29 of the 30 days. It fetched 2,527 different pages, read robots.txt 161 times, sitemaps 54 times and llms.txt 2 times. 459 of its requests got an error status (4xx or 5xx).

Verified requests3,58629 of 30 days
Different pages fetched2,5273,346 page requests
robots.txt reads161sitemaps 54, llms.txt 2
Requests faking its name1,144same user agent, not verified
  • Verified requests
Verified AhrefsBot requests per day to rankecho.io, 17 October to 15 November 2026
DateVerified requests
Oct 170
Oct 1880
Oct 1910
Oct 2010
Oct 2150
Oct 2250
Oct 23290
Oct 2480
Oct 2563
Oct 2642
Oct 274
Oct 287
Oct 2910
Oct 3028
Oct 3152
Nov 1534
Nov 2661
Nov 3279
Nov 4318
Nov 595
Nov 636
Nov 733
Nov 893
Nov 947
Nov 1020
Nov 1134
Nov 12115
Nov 13417
Nov 1474
Nov 1554
Pages AhrefsBot fetched most
PathRequests
/benchmark/homefurniturenyc.com20
/benchmark/subsconscious.com16
/benchmark/darussalamny.com14
/benchmark/greatmany.com14
/benchmark/jennynguyen51.glossgenius.com14

Also in those days, 1,144 requests used AhrefsBot's user agent without Cloudflare verifying it.

Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 680 of the verified requests, so those counts are estimates.

Allowing or blocking AhrefsBot

RankEcho's audits do not read the AhrefsBot token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.

Blocking AhrefsBot keeps your pages and links out of Ahrefs' fresh data, so Ahrefs users see less about your site. It does not change Google, Bing or the AI assistants' own crawlers.

Allow AhrefsBot

User-agent: AhrefsBot
Allow: /

Block AhrefsBot

User-agent: AhrefsBot
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for AhrefsBot replaces the rules under User-agent: * for that crawler.

How to check a visit is really AhrefsBot

Ahrefs publishes the IP ranges its crawlers use. A request from outside them is not Ahrefs. Cloudflare marks real requests as verified bots.

Source: Ahrefs: AhrefsBot.

Questions about AhrefsBot

What is AhrefsBot?

AhrefsBot crawls the web to build the link and page index behind Ahrefs' SEO tools.

Should I block AhrefsBot?

Blocking AhrefsBot keeps your pages and links out of Ahrefs' fresh data, so Ahrefs users see less about your site. It does not change Google, Bing or the AI assistants' own crawlers.

How do I know a visit is really from AhrefsBot?

Ahrefs publishes the IP ranges its crawlers use. A request from outside them is not Ahrefs. Cloudflare marks real requests as verified bots.

How often does AhrefsBot visit a site?

On rankecho.io, AhrefsBot made 3,586 Cloudflare-verified requests from 17 October to 15 November 2026, on 29 of the 30 days. Your site will differ with its size and how often it changes.

Why does AhrefsBot crawl more than Googlebot?

On rankecho.io it did, over the same 30 days. SEO tool crawlers refresh link data across the whole web, so they can fetch a site more often than a search engine does.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against Ahrefs's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.