AI crawler
What is AI2Bot?
AI2Bot is the crawler of the Allen Institute for AI. It collects public web pages used to train Ai2's open language models. Blocking AI2Bot opts your future pages out of Ai2's crawl.
- Operator
- Ai2 (Allen Institute for AI)
- What it does
- Collects pages for AI training
- robots.txt token
AI2Bot- Verified on rankecho.io, 30 days
- 0 requests
What AI2Bot did on rankecho.io
Nothing yet. No request to rankecho.io carried AI2Bot's user agent from 17 October to 15 November 2026, verified or not. Training crawlers visit on their own schedule and may skip a small, young site for a while.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16.
Allowing or blocking AI2Bot
RankEcho's audits do not read the AI2Bot token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.
Blocking AI2Bot opts your future pages out of Ai2's crawl. It does not change any search engine or AI assistant's own crawler.
Allow AI2Bot
User-agent: AI2Bot Allow: /
Block AI2Bot
User-agent: AI2Bot Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for AI2Bot replaces the rules under User-agent: * for that crawler.
How to check a visit is really AI2Bot
Cloudflare checks requests against Ai2's known addresses and marks real ones as verified bots, which is how this page tells real visits from borrowed names. The user agent alone proves nothing.
Source: Ai2: AI2Bot crawler.
Questions about AI2Bot
What is AI2Bot?
AI2Bot is the crawler of the Allen Institute for AI. It collects public web pages used to train Ai2's open language models.
Should I block AI2Bot?
Blocking AI2Bot opts your future pages out of Ai2's crawl. It does not change any search engine or AI assistant's own crawler.
How do I know a visit is really from AI2Bot?
Cloudflare checks requests against Ai2's known addresses and marks real ones as verified bots, which is how this page tells real visits from borrowed names. The user agent alone proves nothing.
How often does AI2Bot visit a site?
On rankecho.io, Cloudflare verified no request from AI2Bot from 17 October to 15 November 2026, although 0 requests used its user agent.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Ai2 (Allen Institute for AI)'s documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
