search indexes

TikTokSpider

Operated by ByteDance · Search indexes

TikTokSpider is tracked as a search or answer-index crawler from ByteDance.

When TikTokSpider shows up in your logs

ByteDance is indexing your page for TikTok's search experiences.

Discovery crawlers that keep a search or answer index fresh.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: TikTokSpider
Disallow:
block
User-agent: TikTokSpider
Disallow: /

More from ByteDance

Is TikTokSpider on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.