training crawlers

meta-externalagent

Operated by Meta · Training crawlers

Meta crawler for indexing or improving Meta products and AI systems.

When meta-externalagent shows up in your logs

Meta is crawling your page to index or improve its products and AI systems.

Crawlers that collect public content that may be used to train or ground models.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: meta-externalagent
Disallow:
block
User-agent: meta-externalagent
Disallow: /

Is meta-externalagent on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.