On-request crawler
What is AhrefsSiteAudit?
AhrefsSiteAudit is the crawler behind Ahrefs' Site Audit, which Ahrefs users run to check a site for technical SEO problems. Blocking it stops Ahrefs Site Audit runs on your site, including your own.
- Operator
- Ahrefs
- What it does
- Fetches pages when its user runs a check
- robots.txt token
AhrefsSiteAudit- Verified on rankecho.io, 30 days
- 4,490 requests
What AhrefsSiteAudit did on rankecho.io
From 17 October to 15 November 2026, Cloudflare verified 4,490 requests from AhrefsSiteAudit, on 6 of the 30 days. It fetched 749 different pages, read robots.txt 12 times, sitemaps 41 times and llms.txt 0 times. 30 of its requests got an error status (4xx or 5xx).
- Verified requests
| Date | Verified requests |
|---|---|
| Oct 17 | 0 |
| Oct 18 | 0 |
| Oct 19 | 0 |
| Oct 20 | 0 |
| Oct 21 | 1,000 |
| Oct 22 | 0 |
| Oct 23 | 0 |
| Oct 24 | 20 |
| Oct 25 | 0 |
| Oct 26 | 0 |
| Oct 27 | 0 |
| Oct 28 | 1,145 |
| Oct 29 | 0 |
| Oct 30 | 0 |
| Oct 31 | 14 |
| Nov 1 | 0 |
| Nov 2 | 0 |
| Nov 3 | 0 |
| Nov 4 | 1,152 |
| Nov 5 | 0 |
| Nov 6 | 0 |
| Nov 7 | 0 |
| Nov 8 | 0 |
| Nov 9 | 0 |
| Nov 10 | 0 |
| Nov 11 | 1,159 |
| Nov 12 | 0 |
| Nov 13 | 0 |
| Nov 14 | 0 |
| Nov 15 | 0 |
| Path | Requests |
|---|---|
/ | 1,531 |
/login | 27 |
/answers/why-ai-recommends-competitors | 13 |
/benchmark/1836wellness.com | 13 |
/benchmark/allansbakery.com | 13 |
Also in those days, 0 requests used AhrefsSiteAudit's user agent without Cloudflare verifying it.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 1,060 of the verified requests, so those counts are estimates.
Allowing or blocking AhrefsSiteAudit
RankEcho's audits do not read the AhrefsSiteAudit token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.
Blocking it stops Ahrefs Site Audit runs on your site, including your own. Ahrefs' Site Audit bot page explains how it treats robots.txt for site owners who verified their site.
Allow AhrefsSiteAudit
User-agent: AhrefsSiteAudit Allow: /
Block AhrefsSiteAudit
User-agent: AhrefsSiteAudit Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for AhrefsSiteAudit replaces the rules under User-agent: * for that crawler.
How to check a visit is really AhrefsSiteAudit
Ahrefs publishes the IP ranges its crawlers use. A request from outside them is not Ahrefs. Cloudflare marks real requests as verified bots.
Source: Ahrefs: Site Audit bot.
Questions about AhrefsSiteAudit
What is AhrefsSiteAudit?
AhrefsSiteAudit is the crawler behind Ahrefs' Site Audit, which Ahrefs users run to check a site for technical SEO problems.
Should I block AhrefsSiteAudit?
Blocking it stops Ahrefs Site Audit runs on your site, including your own. Ahrefs' Site Audit bot page explains how it treats robots.txt for site owners who verified their site.
How do I know a visit is really from AhrefsSiteAudit?
Ahrefs publishes the IP ranges its crawlers use. A request from outside them is not Ahrefs. Cloudflare marks real requests as verified bots.
How often does AhrefsSiteAudit visit a site?
On rankecho.io, AhrefsSiteAudit made 4,490 Cloudflare-verified requests from 17 October to 15 November 2026, on 6 of the 30 days. Your site will differ with its size and how often it changes.
Why do AhrefsSiteAudit visits come in bursts?
Each burst is one audit someone ran in Ahrefs. A run fetches many pages in a short time, then nothing until the next run.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Ahrefs's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
