What AwarioSmartBot does
AwarioSmartBot is one of the crawlers that collect public web data for the Awario application, which is used to find who is mentioning a brand online. It makes at most one request every 3 seconds, or less often if a site specifies a longer crawl delay, and it does not send recurring requests to the same page, fetching content only once or when updates are needed. It obeys robots.txt rules, including Disallow and Crawl-delay directives targeted at the AwarioSmartBot user-agent.
How to control AwarioSmartBot
Target AwarioSmartBot in your robots.txt with the AwarioSmartBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow AwarioSmartBot
User-agent: AwarioSmartBot
Allow: /Block AwarioSmartBot
User-agent: AwarioSmartBot
Disallow: /Awario states the bot does not crawl from any consecutive IP blocks, so it should be identified by its user-agent string rather than by IP, and it honors both Disallow and Crawl-delay directives in robots.txt.
How to identify AwarioSmartBot
Temso identifies AwarioSmartBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
AwarioSmartBotAwarioSmartBot FAQ
What is AwarioSmartBot?
AwarioSmartBot is a web crawler operated by Awario that collects publicly available web data used by the Awario social listening application to surface brand mentions. It identifies itself with the user-agent string AwarioSmartBot/1.0 (+https://awario.com/bots.html; bots@awario.com).
How do I block AwarioSmartBot?
Add a robots.txt group with User-agent: AwarioSmartBot and Disallow: / to block it entirely, or use a Crawl-delay directive to slow it down instead. Awario documents that its bots respect these rules; note that Awario also runs a separate AwarioRssBot that needs its own group if you want to block both.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
