AI agent
What is Meta-ExternalFetcher?
Meta-ExternalFetcher fetches individual links when a person using a Meta AI product asks for them. It is not an automatic crawler. Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules.
- Operator
- Meta
- What it does
- Fetches a page when a user asks
- robots.txt token
meta-externalfetcher- Verified on rankecho.io, 30 days
- 0 requests
What Meta-ExternalFetcher did on rankecho.io
Nothing yet. No request to rankecho.io carried Meta-ExternalFetcher's user agent from 17 October to 15 November 2026, verified or not. It only comes when a person asks the assistant about a page, so a site can go weeks without a visit.
Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16.
Allowing or blocking Meta-ExternalFetcher
RankEcho's audits do not read the meta-externalfetcher token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.
Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules. A firewall rule is the way to block it.
Allow Meta-ExternalFetcher
User-agent: meta-externalfetcher Allow: /
Block Meta-ExternalFetcher
User-agent: meta-externalfetcher Disallow: /
Put the lines in the robots.txt file at the root of your domain. A more specific group for meta-externalfetcher replaces the rules under User-agent: * for that crawler.
How to check a visit is really Meta-ExternalFetcher
Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.
Source: Meta: Meta web crawlers.
Questions about Meta-ExternalFetcher
What is Meta-ExternalFetcher?
Meta-ExternalFetcher fetches individual links when a person using a Meta AI product asks for them. It is not an automatic crawler.
Should I block Meta-ExternalFetcher?
Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules. A firewall rule is the way to block it.
How do I know a visit is really from Meta-ExternalFetcher?
Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.
How often does Meta-ExternalFetcher visit a site?
On rankecho.io, Cloudflare verified no request from Meta-ExternalFetcher from 17 October to 15 November 2026, although 0 requests used its user agent.
Related crawlers
Check what your robots.txt allows
The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.
Facts checked 2026-11-16 against Meta's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.
