training crawlers

Amazonbot

Operated by Amazon · Training crawlers

Amazon crawler used to improve Amazon products and services.

When Amazonbot shows up in your logs

Amazon is crawling your page to improve its products and services.

Crawlers that collect public content that may be used to train or ground models.

Allow or block it in robots.txt

A robots.txt entry is a request. Well-behaved crawlers honor it; it is not an enforcement mechanism.

allow
User-agent: Amazonbot
Disallow:
block
User-agent: Amazonbot
Disallow: /

More from Amazon

Is Amazonbot on your site right now?

Voris AI visibility answers that: verified AI agent traffic, split from your human visitors, on every plan. Cookieless, with a free plan and a 14-day trial that needs no card.