What Amazon Q does
Amazon Q Business Web Crawler indexes websites for Amazon Q Business, the AWS generative assistant, on behalf of the AWS customer who configured it. It adheres to the rules in a site's robots.txt file, respecting standard Allow and Disallow directives to determine which parts of a site it may visit. Site owners can restrict it to specific paths or stop it entirely by adjusting those rules. AWS has announced that Amazon Q Business will no longer be open to new customers starting July 31, 2026.
How to control Amazon Q
Target Amazon Q in your robots.txt with the amazon-QBusiness token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Amazon Q
User-agent: amazon-QBusiness
Allow: /Block Amazon Q
User-agent: amazon-QBusiness
Disallow: /How to identify Amazon Q
Temso identifies Amazon Qtraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
amazon-QBusinessAmazon Q FAQ
What is Amazon Q?
The amazon-QBusiness user agent is the web crawler for Amazon Q Business, the AWS generative assistant. It crawls and indexes websites that an AWS customer has configured as content sources for their assistant.
How do I block Amazon Q?
Add a robots.txt group with "User-agent: amazon-QBusiness" and "Disallow: /" to stop it entirely, or use Allow and Disallow rules under that group to limit it to specific paths. The crawler adheres to the rules set in your robots.txt file.
About AI Search Crawlers
Crawlers that build the retrieval indexes behind AI search products like ChatGPT search and Perplexity. They decide which pages can be cited as sources.
Blocking these keeps your content out of the source index: AI search products can't cite pages they can't crawl.
