RankEcho

AI agent

What is Meta-ExternalFetcher?

Meta-ExternalFetcher fetches individual links when a person using a Meta AI product asks for them. It is not an automatic crawler. Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules.

Operator
Meta
What it does
Fetches a page when a user asks
robots.txt token
meta-externalfetcher
Verified on rankecho.io, 30 days
0 requests

What Meta-ExternalFetcher did on rankecho.io

Nothing yet. No request to rankecho.io carried Meta-ExternalFetcher's user agent from 17 October to 15 November 2026, verified or not. It only comes when a person asks the assistant about a page, so a site can go weeks without a visit.

Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16.

Allowing or blocking Meta-ExternalFetcher

RankEcho's audits do not read the meta-externalfetcher token yet, so there is no count of sites blocking it. The audit checks the AI and search crawlers that decide whether you can be cited.

Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules. A firewall rule is the way to block it.

Allow Meta-ExternalFetcher

User-agent: meta-externalfetcher
Allow: /

Block Meta-ExternalFetcher

User-agent: meta-externalfetcher
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for meta-externalfetcher replaces the rules under User-agent: * for that crawler.

How to check a visit is really Meta-ExternalFetcher

Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.

Source: Meta: Meta web crawlers.

Questions about Meta-ExternalFetcher

What is Meta-ExternalFetcher?

Meta-ExternalFetcher fetches individual links when a person using a Meta AI product asks for them. It is not an automatic crawler.

Should I block Meta-ExternalFetcher?

Meta says that because a user asked for the fetch, Meta-ExternalFetcher may bypass robots.txt rules. A firewall rule is the way to block it.

How do I know a visit is really from Meta-ExternalFetcher?

Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.

How often does Meta-ExternalFetcher visit a site?

On rankecho.io, Cloudflare verified no request from Meta-ExternalFetcher from 17 October to 15 November 2026, although 0 requests used its user agent.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against Meta's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.