training crawlers

ChatGLM-Spider

Operated by Zhipu AI · Training crawlers

Zhipu AI sends this to gather public content that may go into training ChatGLM.

When ChatGLM-Spider shows up in your logs

Zhipu AI is gathering content that may train ChatGLM. The name is self-reported and easy to spoof.

Crawlers that collect public content that may be used to train or ground models.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: ChatGLM-Spider
Disallow:
block
User-agent: ChatGLM-Spider
Disallow: /

Is ChatGLM-Spider on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.