robots.txt token
What is Google-Extended?
Google-Extended is a robots.txt token, not a crawler. It tells Google whether pages Googlebot crawled may be used to train future Gemini models and to ground Gemini answers. Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking.
- Operator
- What it does
- robots.txt control token, no crawler of its own
- robots.txt token
Google-Extended- Verified on rankecho.io, 30 days
- Never visits
What Google-Extended did on rankecho.io
Nothing, and that is expected: Google-Extended is a robots.txt token, so no request ever carries it. The fetches it controls are Googlebot's. Over 17 October to 15 November 2026 Googlebot made 1,751 verified requests to rankecho.io, read robots.txt 379 times and fetched 217 different pages. See Googlebot's numbers.
How many sites block Google-Extended
1 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Google-Extended from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.
Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking. No request ever arrives with Google-Extended in its user agent, so it never shows in logs.
Allow Google-Extended
User-agent: Google-Extended Allow: /
Block Google-Extended
User-agent: Google-Extended Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for Google-Extended replaces the rules under User-agent: * for that crawler.
How to check a visit is really Google-Extended
Nothing to verify: Google-Extended never visits. The fetches are Googlebot's.
Source: Google: Google's common crawlers.
Questions about Google-Extended
What is Google-Extended?
Google-Extended is a robots.txt token, not a crawler. It tells Google whether pages Googlebot crawled may be used to train future Gemini models and to ground Gemini answers.
Should I block Google-Extended?
Disallowing Google-Extended does not change Google Search, AI Overviews or your ranking. No request ever arrives with Google-Extended in its user agent, so it never shows in logs.
How do I know a visit is really from Google-Extended?
Nothing to verify: Google-Extended never visits. The fetches are Googlebot's.
How many sites block Google-Extended?
1 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Google-Extended from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.
Does blocking Google-Extended remove me from AI Overviews?
No. Google says Google-Extended does not affect Search, and AI Overviews are part of Search. Only blocking Googlebot removes pages from them.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Google's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
