What AwarioBot does
AwarioBot covers Awario's crawlers, AwarioSmartBot and AwarioRssBot, which collect web data the Awario application uses to let internet marketers find who is mentioning their brand online. The bots visit a page only when its data has never been collected or needs to be refreshed, so sites should not see recurring requests to the same page. They make at most 1 request per 3 seconds, or less frequently if a crawl-delay is specified in robots.txt, and their user agents reference https://awario.com/bots.html.
How to control AwarioBot
Target AwarioBot in your robots.txt with the AwarioBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow AwarioBot
User-agent: AwarioBot
Allow: /Block AwarioBot
User-agent: AwarioBot
Disallow: /Awario states the bots honor the crawl-delay directive in robots.txt and explicitly asks site owners not to identify them by IP, since they do not use any consecutive IP blocks.
How to identify AwarioBot
Temso identifies AwarioBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
AwarioBotAwarioBot FAQ
What is AwarioBot?
AwarioBot refers to Awario's crawlers (AwarioSmartBot and AwarioRssBot), which collect web data so Awario users can find mentions of their brand online. They identify themselves with user agents such as "Mozilla/5.0 (compatible; AwarioBot/1.0; +https://awario.com/bots.html)".
How do I block AwarioBot?
Add robots.txt groups for "User-agent: AwarioSmartBot" and "User-agent: AwarioRssBot" with Disallow rules, or use crawl-delay to throttle them; the bots already limit themselves to 1 request per 3 seconds and slow down further if your robots.txt specifies a larger crawl-delay. Blocking by IP is not reliable, since Awario states the bots do not use any consecutive IP blocks.
About SEO & Analytics Crawlers
Crawlers behind SEO and marketing-intelligence platforms: backlink databases, site audits, rank tracking, and brand monitoring.
Blocking these has no effect on search or AI visibility. It mainly limits what third-party tools (including your competitors' tools) can see about your site.
