What SBIntuitionsBot does
SBIntuitionsBot is a crawler operated by SB Intuitions Corp. that collects web data for the company's AI development and information analysis. It is distinct from SBIntuitions-SearchBot, a separate SB Intuitions agent that fetches pages on behalf of users of the company's Sarashina service and whose retrieved content is not used for AI development. SBIntuitionsBot follows the RFC 9309 Robots Exclusion Protocol, and the company notes there is a time lag between publishing robots.txt settings and the crawler honoring them.
How to control SBIntuitionsBot
Target SBIntuitionsBot in your robots.txt with the SBIntuitionsBot token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow SBIntuitionsBot
User-agent: SBIntuitionsBot
Allow: /Block SBIntuitionsBot
User-agent: SBIntuitionsBot
Disallow: /SB Intuitions states the crawler follows the RFC 9309 Robots Exclusion Protocol but that a certain amount of time passes between publishing robots.txt changes and the crawler complying with them.
How to identify SBIntuitionsBot
Temso identifies SBIntuitionsBottraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
SBIntuitionsBotSBIntuitionsBot FAQ
What is SBIntuitionsBot?
SBIntuitionsBot is a web crawler run by SB Intuitions Corp. that collects web data for the company's AI development and information analysis. It is separate from SBIntuitions-SearchBot, which fetches pages for users of the Sarashina service and is not used for AI development.
How do I block SBIntuitionsBot?
Add a robots.txt group with "User-Agent: SBIntuitionsBot" followed by a Disallow rule such as "Disallow: /", per the company's documented example. Note that SB Intuitions says there is a time lag between publishing robots.txt settings and the crawler honoring them.
About AI Training Crawlers
Crawlers that collect content to train foundation models. Data gathered today shapes what future model versions know about your brand.
Blocking these doesn't affect live citations, but it limits what future models learn about you from your own site, leaving third-party sources to fill the gap.
