Search engine crawler
What is DuckDuckBot?
DuckDuckBot is DuckDuckGo's own web crawler. DuckDuckGo builds its results from many sources, and its crawler is one of them. Blocking DuckDuckBot stops DuckDuckGo's own crawler.
- Operator
- DuckDuckGo
- What it does
- Search engine crawler
- robots.txt token
DuckDuckBot- Verified on rankecho.io, 30 days
- 24 requests
What DuckDuckBot did on rankecho.io
From 17 October to 15 November 2026, Cloudflare verified 24 requests from DuckDuckBot, on 7 of the 30 days. It fetched 1 different page, read robots.txt 0 times, sitemaps 0 times and llms.txt 0 times.
- Verified requests
| Date | Verified requests |
|---|---|
| Oct 17 | 0 |
| Oct 18 | 0 |
| Oct 19 | 0 |
| Oct 20 | 0 |
| Oct 21 | 0 |
| Oct 22 | 0 |
| Oct 23 | 0 |
| Oct 24 | 0 |
| Oct 25 | 0 |
| Oct 26 | 3 |
| Oct 27 | 0 |
| Oct 28 | 0 |
| Oct 29 | 3 |
| Oct 30 | 0 |
| Oct 31 | 0 |
| Nov 1 | 3 |
| Nov 2 | 0 |
| Nov 3 | 0 |
| Nov 4 | 0 |
| Nov 5 | 3 |
| Nov 6 | 0 |
| Nov 7 | 0 |
| Nov 8 | 0 |
| Nov 9 | 0 |
| Nov 10 | 3 |
| Nov 11 | 3 |
| Nov 12 | 0 |
| Nov 13 | 6 |
| Nov 14 | 0 |
| Nov 15 | 0 |
| Path | Requests |
|---|---|
/ | 16 |
Also in those days, 0 requests used DuckDuckBot's user agent without Cloudflare verifying it.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16.
Allowing or blocking DuckDuckBot
RankEcho's audits do not read the DuckDuckBot token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.
Blocking DuckDuckBot stops DuckDuckGo's own crawler. DuckDuckGo's AI-assisted answers fetch pages with DuckAssistBot, which has its own token.
Allow DuckDuckBot
User-agent: DuckDuckBot Allow: /
Block DuckDuckBot
User-agent: DuckDuckBot Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for DuckDuckBot replaces the rules under User-agent: * for that crawler.
How to check a visit is really DuckDuckBot
DuckDuckGo publishes the IP addresses DuckDuckBot uses on its help page. A request from another address is not DuckDuckBot.
Source: DuckDuckGo: DuckDuckBot.
Questions about DuckDuckBot
What is DuckDuckBot?
DuckDuckBot is DuckDuckGo's own web crawler. DuckDuckGo builds its results from many sources, and its crawler is one of them.
Should I block DuckDuckBot?
Blocking DuckDuckBot stops DuckDuckGo's own crawler. DuckDuckGo's AI-assisted answers fetch pages with DuckAssistBot, which has its own token.
How do I know a visit is really from DuckDuckBot?
DuckDuckGo publishes the IP addresses DuckDuckBot uses on its help page. A request from another address is not DuckDuckBot.
How often does DuckDuckBot visit a site?
On rankecho.io, DuckDuckBot made 24 Cloudflare-verified requests from 17 October to 15 November 2026, on 7 of the 30 days. Your site will differ with its size and how often it changes.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against DuckDuckGo's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
