training crawlers
meta-externalagent
Operated by Meta · Training crawlers
Meta's crawler that collects public pages to index and improve its AI systems.
When meta-externalagent shows up in your logs
Meta is gathering your content to index and improve its AI systems.
Crawlers that collect public content that may be used to train or ground models.
Allow or block it in robots.txt
A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.
More from Meta
Is meta-externalagent on your site right now?
Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.