Semrush bots

2 bots in the directory · Reviewed July 2026

Semrush operates 2 bots tracked in this directory. Each page below covers what the bot does and how to identify it.

SiteAuditBot

Semrush's Site Audit crawler for on-page and technical SEO issues.

SEO Tools

SemrushBot

Semrush's crawler for SEO, content, and competitive research.

SEO Tools

Control every Semrush bot at once

robots.txt lets one rule group target multiple user-agents. These snippets cover all 2 Semrush tokens in this directory. For finer control, set rules per bot on each bot's page.

Allow all Semrush bots

User-agent: SiteAuditBot
User-agent: SemrushBot
Allow: /

Block all Semrush bots

User-agent: SiteAuditBot
User-agent: SemrushBot
Disallow: /

← Back to the AI Bot Directory