General crawler
What is GoogleOther?
GoogleOther is Google's general-purpose crawler. Google product teams use it to fetch public pages for jobs outside Search, such as one-off crawls for internal research and development. GoogleOther is separate from Googlebot, so blocking it does not remove your pages from Google Search.
- Operator
- What it does
- General-purpose crawler
- robots.txt token
GoogleOther- Verified on rankecho.io, 30 days
- 63 requests
What GoogleOther did on rankecho.io
From 17 October to 15 November 2026, Cloudflare verified 63 requests from GoogleOther, on 10 of the 30 days. It fetched 19 different pages, read robots.txt 10 times, sitemaps 0 times and llms.txt 0 times.
- Verified requests
| Date | Verified requests |
|---|---|
| Oct 17 | 10 |
| Oct 18 | 0 |
| Oct 19 | 0 |
| Oct 20 | 0 |
| Oct 21 | 0 |
| Oct 22 | 0 |
| Oct 23 | 0 |
| Oct 24 | 10 |
| Oct 25 | 22 |
| Oct 26 | 0 |
| Oct 27 | 0 |
| Oct 28 | 0 |
| Oct 29 | 0 |
| Oct 30 | 1 |
| Oct 31 | 0 |
| Nov 1 | 0 |
| Nov 2 | 0 |
| Nov 3 | 0 |
| Nov 4 | 2 |
| Nov 5 | 0 |
| Nov 6 | 0 |
| Nov 7 | 2 |
| Nov 8 | 1 |
| Nov 9 | 0 |
| Nov 10 | 0 |
| Nov 11 | 7 |
| Nov 12 | 7 |
| Nov 13 | 1 |
| Nov 14 | 0 |
| Nov 15 | 0 |
| Path | Requests |
|---|---|
/downloads/ahrefs-index-prompt-evaluation-v1.docx | 10 |
/learn/ai-seo | 10 |
/ | 5 |
/benchmark/advancingjustice-la.org | 1 |
/benchmark/blvdier.com | 1 |
Also in those days, 0 requests used GoogleOther's user agent without Cloudflare verifying it.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 30 of the verified requests, so those counts are estimates.
How many sites block GoogleOther
1 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block GoogleOther from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.
GoogleOther is separate from Googlebot, so blocking it does not remove your pages from Google Search. It opts them out of those other Google fetches.
Allow GoogleOther
User-agent: GoogleOther Allow: /
Block GoogleOther
User-agent: GoogleOther Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for GoogleOther replaces the rules under User-agent: * for that crawler.
How to check a visit is really GoogleOther
Run a reverse DNS lookup on the IP: it should end in googlebot.com, google.com or googleusercontent.com, and a forward lookup of that name should return the same IP. Google also publishes its crawler IP ranges.
Source: Google: Google's common crawlers.
Questions about GoogleOther
What is GoogleOther?
GoogleOther is Google's general-purpose crawler. Google product teams use it to fetch public pages for jobs outside Search, such as one-off crawls for internal research and development.
Should I block GoogleOther?
GoogleOther is separate from Googlebot, so blocking it does not remove your pages from Google Search. It opts them out of those other Google fetches.
How do I know a visit is really from GoogleOther?
Run a reverse DNS lookup on the IP: it should end in googlebot.com, google.com or googleusercontent.com, and a forward lookup of that name should return the same IP. Google also publishes its crawler IP ranges.
How often does GoogleOther visit a site?
On rankecho.io, GoogleOther made 63 Cloudflare-verified requests from 17 October to 15 November 2026, on 10 of the 30 days. Your site will differ with its size and how often it changes.
How many sites block GoogleOther?
1 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block GoogleOther from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Google's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
