training crawlers

ERNIEBot

Operated by Baidu · Training crawlers

ERNIEBot is tracked as a public-content crawler from Baidu.

When ERNIEBot shows up in your logs

Baidu is collecting public content that may train ERNIE.

Crawlers that collect public content that may be used to train or ground models.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: ERNIEBot
Disallow:
block
User-agent: ERNIEBot
Disallow: /

More from Baidu

Is ERNIEBot on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.