RankEcho

AI crawler

What is ExaSearchBot?

ExaSearchBot crawls the web for Exa, a search engine that AI applications query through an API. Exa says a group for ExaSearchBot in robots.txt comes first; without one it follows your rules for major search engines, then the * group.

Operator
Exa
What it does
Builds an AI search index
robots.txt token
ExaSearchBot
Verified on rankecho.io, 30 days
1,172 requests

What ExaSearchBot did on rankecho.io

From 17 October to 15 November 2026, Cloudflare verified 1,172 requests from ExaSearchBot, on 30 of the 30 days. It fetched 204 different pages, read robots.txt 32 times, sitemaps 2 times and llms.txt 0 times.

Verified requests1,17230 of 30 days
Different pages fetched2041,138 page requests
robots.txt reads32sitemaps 2, llms.txt 0
Requests faking its name8same user agent, not verified
  • Verified requests
Verified ExaSearchBot requests per day to rankecho.io, 17 October to 15 November 2026
DateVerified requests
Oct 1720
Oct 1880
Oct 1960
Oct 2010
Oct 2150
Oct 2270
Oct 2350
Oct 2430
Oct 2543
Oct 2629
Oct 2758
Oct 2839
Oct 2938
Oct 3035
Oct 3134
Nov 135
Nov 266
Nov 339
Nov 437
Nov 540
Nov 642
Nov 734
Nov 850
Nov 927
Nov 1031
Nov 1124
Nov 1232
Nov 1333
Nov 1424
Nov 1512
Pages ExaSearchBot fetched most
PathRequests
/benchmarks/state-of-ai-citations-q3-202670
/product/ai-visibility-audit47
/learn/ai-visibility-for-healthcare40
/compare/agencyanalytics-alternatives38
/resources/find/prompt-gap-analysis37

Also in those days, 8 requests used ExaSearchBot's user agent without Cloudflare verifying it.

Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 380 of the verified requests, so those counts are estimates.

Allowing or blocking ExaSearchBot

RankEcho's audits do not read the ExaSearchBot token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.

Exa says a group for ExaSearchBot in robots.txt comes first; without one it follows your rules for major search engines, then the * group. robots.txt stops crawling, so to drop a page Exa already indexed, add a noindex tag.

Allow ExaSearchBot

User-agent: ExaSearchBot
Allow: /

Block ExaSearchBot

User-agent: ExaSearchBot
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for ExaSearchBot replaces the rules under User-agent: * for that crawler.

How to check a visit is really ExaSearchBot

Exa signs its requests with HTTP Message Signatures (Web Bot Auth), with a Signature-Agent header naming Exa. A request without a valid signature is not Exa.

Source: Exa: ExaSearchBot.

Questions about ExaSearchBot

What is ExaSearchBot?

ExaSearchBot crawls the web for Exa, a search engine that AI applications query through an API.

Should I block ExaSearchBot?

Exa says a group for ExaSearchBot in robots.txt comes first; without one it follows your rules for major search engines, then the * group. robots.txt stops crawling, so to drop a page Exa already indexed, add a noindex tag.

How do I know a visit is really from ExaSearchBot?

Exa signs its requests with HTTP Message Signatures (Web Bot Auth), with a Signature-Agent header naming Exa. A request without a valid signature is not Exa.

How often does ExaSearchBot visit a site?

On rankecho.io, ExaSearchBot made 1,172 Cloudflare-verified requests from 17 October to 15 November 2026, on 30 of the 30 days. Your site will differ with its size and how often it changes.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against Exa's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.