RankEcho

AI crawler

What is Meta-ExternalAgent?

Meta-ExternalAgent crawls pages for uses such as training Meta's AI models and improving its products. Blocking Meta-ExternalAgent opts your pages out of that crawl.

Operator
Meta
What it does
Collects pages for AI training
robots.txt token
meta-externalagent
Verified on rankecho.io, 30 days
61 requests

What Meta-ExternalAgent did on rankecho.io

From 17 October to 15 November 2026, Cloudflare verified 61 requests from Meta-ExternalAgent, on 11 of the 30 days. It fetched 48 different pages, read robots.txt 0 times, sitemaps 0 times and llms.txt 1 time. 1 of its requests got an error status (4xx or 5xx).

Verified requests6111 of 30 days
Different pages fetched4849 page requests
robots.txt reads0sitemaps 0, llms.txt 1
Requests faking its name0same user agent, not verified
  • Verified requests
Verified Meta-ExternalAgent requests per day to rankecho.io, 17 October to 15 November 2026
DateVerified requests
Oct 170
Oct 180
Oct 190
Oct 200
Oct 2110
Oct 220
Oct 230
Oct 240
Oct 250
Oct 261
Oct 276
Oct 281
Oct 290
Oct 300
Oct 310
Nov 11
Nov 22
Nov 31
Nov 41
Nov 50
Nov 60
Nov 70
Nov 80
Nov 934
Nov 102
Nov 112
Nov 120
Nov 130
Nov 140
Nov 150
Pages Meta-ExternalAgent fetched most
PathRequests
/login2
/downloads/organization-schema-kit-v1.zip1
/app/search/connections1
/app/search1
/search-intelligence1

Also in those days, 0 requests used Meta-ExternalAgent's user agent without Cloudflare verifying it.

Source: rankecho.io's Cloudflare logs, visitor requests only, queried 2026-11-16. Cloudflare sampled 10 of the verified requests, so those counts are estimates.

How many sites block Meta-ExternalAgent

2 of 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Meta-ExternalAgent from the whole site. The sample is small and grows with every audit, so read it as a first look rather than a rate for the web.

Blocking Meta-ExternalAgent opts your pages out of that crawl. Link previews on Facebook and Instagram come from a different agent, facebookexternalhit.

Allow Meta-ExternalAgent

User-agent: meta-externalagent
Allow: /

Block Meta-ExternalAgent

User-agent: meta-externalagent
Disallow: /

Put the lines in the robots.txt file at the root of your domain. A more specific group for meta-externalagent replaces the rules under User-agent: * for that crawler.

How to check a visit is really Meta-ExternalAgent

Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.

Source: Meta: Meta web crawlers.

Questions about Meta-ExternalAgent

What is Meta-ExternalAgent?

Meta-ExternalAgent crawls pages for uses such as training Meta's AI models and improving its products.

Should I block Meta-ExternalAgent?

Blocking Meta-ExternalAgent opts your pages out of that crawl. Link previews on Facebook and Instagram come from a different agent, facebookexternalhit.

How do I know a visit is really from Meta-ExternalAgent?

Meta publishes the IP ranges its crawlers use. Cloudflare marks real requests as verified bots.

How often does Meta-ExternalAgent visit a site?

On rankecho.io, Meta-ExternalAgent made 61 Cloudflare-verified requests from 17 October to 15 November 2026, on 11 of the 30 days. Your site will differ with its size and how often it changes.

How many sites block Meta-ExternalAgent?

2 of the 13 sites whose robots.txt RankEcho read in audits from 3 November 2026 to 16 November 2026 block Meta-ExternalAgent from the whole site. It is a small sample, so read it as a first look, not a web-wide rate.

Related crawlers

Check what your robots.txt allows

The free crawler policy check reads your robots.txt and says which AI crawlers it lets in. A free audit also asks ChatGPT, Perplexity and Gemini whether they cite you, and marks a missing answer as crawler access when a crawler is blocked.

Facts checked 2026-11-16 against Meta's documentation. Log numbers from 17 October to 15 November 2026. Read our crawler log study for the method.