RankEcho

Crawling and indexing

What is a verified bot?

A verified bot is a crawler whose requests are confirmed to come from its operator, by reverse DNS or the operator's published IP ranges, not just by its user-agent string, which anyone can copy. Cloudflare and other CDNs mark verified bots for you.

How to read it

Bad actors borrow well-known crawler names to slip past rules that let search engines in. Never allow a crawler on its user-agent string alone.

An unverified request is not always fake. A crawler can use addresses its operator has not published yet. Treat it as unconfirmed, and judge it by what it asks for.

Example from rankecho.io

Borrowed names on rankecho.io

In 30 days, 124 requests used GPTBot's name without Cloudflare verifying them, and 87 of those asked for secret files such as /.env, which no real crawler needs.

Cloudflare verified 0 requests as PerplexityBot, while 1,020 used its name.

Source: rankecho.io's Cloudflare logs, 17 October to 15 November 2026.

Questions people ask

What is a verified bot?

A verified bot is a crawler whose requests are confirmed to come from its operator, by reverse DNS or the operator's published IP ranges, not just by its user-agent string, which anyone can copy. Cloudflare and other CDNs mark verified bots for you.

How do I verify Googlebot?

Run a reverse DNS lookup on the IP, check it ends in googlebot.com or google.com, then a forward lookup to confirm it maps back to the same IP. Or match it against Google's published IP ranges.

Should I block unverified bots?

Block requests for files no crawler needs, such as /.env, whoever sends them. For the rest, rate limits are safer than blanket blocks.

Related terms

Read more on rankecho.io

See it on your own site

RankEcho reads your Search Console data and asks AI assistants whether they cite you, then shows each of these numbers for your pages. The audit is free.

Definition and example checked 2026-11-16.