training crawlers

AI2Bot

Operated by Ai2 · Training crawlers

The Allen Institute's crawler (Ai2), gathering public documents to feed its AI research systems.

When AI2Bot shows up in your logs

The Allen Institute is gathering documents for its AI research systems.

Crawlers that collect public content that may be used to train or ground models.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: AI2Bot
Disallow:
block
User-agent: AI2Bot
Disallow: /

Is AI2Bot on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.