What Amazonbot does
Amazonbot crawls the web to improve Amazon's products and services, including making Alexa answers more accurate and useful. Amazon documents its user agent and supported robots.txt directives.
Should I allow Amazonbot to crawl my site?
Alexa remains one of the largest voice answer surfaces. Allowing Amazonbot keeps your content in the pool Alexa and Amazon's AI features can draw from.
How to control Amazonbot
Target Amazonbot in your robots.txt with the Amazonbot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Amazonbot
User-agent: Amazonbot
Allow: /Block Amazonbot
User-agent: Amazonbot
Disallow: /User-agent string
As published by Amazon. Remember that user-agent strings can be spoofed, so verify suspicious traffic against the operator's published IP ranges.
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)Amazonbot FAQ
What is Amazonbot?
Amazonbot is Amazon's web crawler, used to improve Amazon products and services, including helping Alexa answer more questions for customers, and the data it collects may be used to train Amazon AI models. It appears in logs with a user-agent string containing "Amazonbot", and Amazon publishes its IP address ranges for verification.
How do I block Amazonbot?
Add a robots.txt group with "User-agent: Amazonbot" followed by "Disallow: /" at your domain root. Amazon's documentation notes that its crawlers do not support the crawl-delay directive, and that Amazonbot may use a cached copy of your robots.txt from the last 30 days, so changes are not always picked up immediately.
About AI Training Crawlers
Crawlers that collect content to train foundation models. Data gathered today shapes what future model versions know about your brand.
Blocking these doesn't affect live citations, but it limits what future models learn about you from your own site, leaving third-party sources to fill the gap.