RankEcho

AI crawler

What is OAI-SearchBot?

OAI-SearchBot crawls the web to surface sites in ChatGPT's search results. OpenAI says it is not used to train models. Blocking OAI-SearchBot means your pages may not appear in ChatGPT search answers, though ChatGPT can still show a link to them.

Operator
OpenAI
What it does
Builds an AI search index
robots.txt token
OAI-SearchBot
Verified on rankecho.io, 30 days
166 requests

What OAI-SearchBot did on rankecho.io

From 17 October to 15 November 2026, Cloudflare verified 166 requests from OAI-SearchBot, on 24 of the 30 days. It fetched 25 different pages, read robots.txt 94 times, sitemaps 0 times and llms.txt 1 time.

Verified requests16624 of 30 days
Different pages fetched2560 page requests
robots.txt reads94sitemaps 0, llms.txt 1
Requests faking its name292same user agent, not verified
  • Verified requests
Verified OAI-SearchBot requests per day to rankecho.io, 17 October to 15 November 2026
DateVerified requests
Oct 170
Oct 180
Oct 190
Oct 200
Oct 210
Oct 220
Oct 2310
Oct 247
Oct 254
Oct 2612
Oct 2712
Oct 286
Oct 295
Oct 305
Oct 319
Nov 16
Nov 219
Nov 37
Nov 48
Nov 55
Nov 66
Nov 74
Nov 88
Nov 98
Nov 105
Nov 114
Nov 125
Nov 134
Nov 144
Nov 153
Pages OAI-SearchBot fetched most
PathRequests
/methodology19
/14
/resources/prove/citation-persistence4
/tools/ai-visibility-checker2
/templates/proof-report1

Also in those days, 292 requests used OAI-SearchBot's user agent without Cloudflare verifying it, and 38 of those asked for secret files such as /.env or compose.yml, which no real crawler needs.

Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 10 of the verified requests, so those counts are estimates.

How many sites block OAI-SearchBot

1 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block OAI-SearchBot from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.

Blocking OAI-SearchBot means your pages may not appear in ChatGPT search answers, though ChatGPT can still show a link to them. It does not change GPTBot training crawls.

Allow OAI-SearchBot

User-agent: OAI-SearchBot
Allow: /

Block OAI-SearchBot

User-agent: OAI-SearchBot
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for OAI-SearchBot replaces the rules under User-agent: * for that crawler.

How to check a visit is really OAI-SearchBot

OpenAI publishes the IP ranges for each of its crawlers as JSON files linked from its crawler page. A request with the user agent but an IP outside those ranges is not OpenAI. Cloudflare checks this for you and marks real requests as verified bots.

Source: OpenAI: Overview of OpenAI crawlers.

Questions about OAI-SearchBot

What is OAI-SearchBot?

OAI-SearchBot crawls the web to surface sites in ChatGPT's search results. OpenAI says it is not used to train models.

Should I block OAI-SearchBot?

Blocking OAI-SearchBot means your pages may not appear in ChatGPT search answers, though ChatGPT can still show a link to them. It does not change GPTBot training crawls.

How do I know a visit is really from OAI-SearchBot?

OpenAI publishes the IP ranges for each of its crawlers as JSON files linked from its crawler page. A request with the user agent but an IP outside those ranges is not OpenAI. Cloudflare checks this for you and marks real requests as verified bots.

How often does OAI-SearchBot visit a site?

On rankecho.io, OAI-SearchBot made 166 Cloudflare-verified requests from 17 October to 15 November 2026, on 24 of the 30 days. Your site will differ with its size and how often it changes.

How many sites block OAI-SearchBot?

1 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block OAI-SearchBot from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.

Should I allow OAI-SearchBot?

If you want ChatGPT search to cite your pages, yes. It is the crawler that builds the index ChatGPT search draws on, and OpenAI says it is not used for training.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against OpenAI's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.