meta-externalfetcher

Meta · User-triggered fetchers · json

User-agent: meta-externalfetcher
Disallow: /
robots.txt tokenmeta-externalfetcher
User-agent containsmeta-externalfetcher
OperatorMeta
CategoryUser-triggered fetchers
robots.txtobeys robots.txt (documented)
Verify byno published verification method

What it is

Fetches a page when a Meta AI user asks about a specific link.

What blocking it costs you

Meta AI cannot read pages users hand it.

Full user-agent string

meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)

Allow it instead

User-agent: meta-externalfetcher
Allow: /

Operator documentation: https://developers.facebook.com/docs/sharing/webmasters/web-crawlers
Machine copies: json · markdown
Policies that name this crawler: allow-all · block-all-ai · allow-ai-search-only · maximum-ai-visibility