training crawlers
cohere-training-data-crawler
Operated by Cohere · Training crawlers
cohere-training-data-crawler is tracked as a public-content crawler from Cohere.
When cohere-training-data-crawler shows up in your logs
Cohere is collecting public content that may train a future model.
Crawlers that collect public content that may be used to train or ground models.
Allow or block it in robots.txt
A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.
More from Cohere
Is cohere-training-data-crawler on your site right now?
Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.