RankEcho

robots.txt token

What is Google-Extended?

Google-Extended is a robots.txt token, not a crawler. It tells Google whether pages Googlebot crawled may be used to train future Gemini models and to ground Gemini answers. Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking.

Operator
Google
What it does
robots.txt control token, no crawler of its own
robots.txt token
Google-Extended
Verified on rankecho.io, 30 days
Never visits

What Google-Extended did on rankecho.io

Nothing, and that is expected: Google-Extended is a robots.txt token, so no request ever carries it. The fetches it controls are Googlebot's. Over 17 October to 15 November 2026 Googlebot made 1,751 verified requests to rankecho.io, read robots.txt 379 times and fetched 217 different pages. See Googlebot's numbers.

How many sites block Google-Extended

1 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Google-Extended from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.

Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking. No request ever arrives with Google-Extended in its user agent, so it never shows in logs.

Allow Google-Extended

User-agent: Google-Extended
Allow: /

Block Google-Extended

User-agent: Google-Extended
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for Google-Extended replaces the rules under User-agent: * for that crawler.

How to check a visit is really Google-Extended

Nothing to verify: Google-Extended never visits. The fetches are Googlebot's.

Source: Google: Google's common crawlers.

Questions about Google-Extended

What is Google-Extended?

Google-Extended is a robots.txt token, not a crawler. It tells Google whether pages Googlebot crawled may be used to train future Gemini models and to ground Gemini answers.

Should I block Google-Extended?

Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking. No request ever arrives with Google-Extended in its user agent, so it never shows in logs.

How do I know a visit is really from Google-Extended?

Nothing to verify: Google-Extended never visits. The fetches are Googlebot's.

How many sites block Google-Extended?

1 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Google-Extended from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.

Does blocking Google-Extended remove me from AI Overviews?

No. Google says Google-Extended does not affect Search, and AI Overviews are part of Search. Only blocking Googlebot removes pages from them.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against Google's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.