training crawlers
Applebot
Operated by Apple · Training crawlers
Apple's crawler, which Cloudflare places across both search and training uses, feeding Siri, Spotlight, and Safari.
When Applebot shows up in your logs
Apple is crawling for Siri, Spotlight, and Safari, and possibly AI training too.
Crawlers that collect public content that may be used to train or ground models.
Allow or block it in robots.txt
A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.
More from Apple
Is Applebot on your site right now?
Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.