What Storebot-Google does
Storebot-Google is the Google crawler that serves all surfaces of Google Shopping, such as the Shopping tab in Google Search and Google Shopping. It crawls with desktop and mobile user-agent variants that both include the Storebot-Google/1.0 token. Like Google's other common crawlers, it always obeys robots.txt rules and crawls from the IP ranges Google publishes in the common-crawlers.json object.
How to control Storebot-Google
Target Storebot-Google in your robots.txt with the Storebot-Google token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.
Allow Storebot-Google
User-agent: Storebot-Google
Allow: /Block Storebot-Google
User-agent: Storebot-Google
Disallow: /Storebot-Google always obeys robots.txt and can be verified against Google's published IP ranges in common-crawlers.json or by reverse DNS matching crawl-***-***-***-***.googlebot.com or geo-crawl-***-***-***-***.geo.googlebot.com, since the user-agent string alone can be spoofed.
How to identify Storebot-Google
Temso identifies Storebot-Googletraffic by matching the request's User-Agent header against this pattern. User-agent strings can be spoofed, so treat a match as an indication, not proof.
Storebot-GoogleStorebot-Google FAQ
What is Storebot-Google?
Storebot-Google is Google's crawler for shopping content, serving all surfaces of Google Shopping, including the Shopping tab in Google Search. It appears in logs with desktop and mobile user-agent strings containing Storebot-Google/1.0.
How do I block Storebot-Google?
Add a robots.txt group with "User-agent: Storebot-Google" followed by "Disallow: /" (or a narrower path). Google documents that its common crawlers always obey robots.txt rules, so a rule targeting this token is respected.
About Search Engine Crawlers
Classic search indexers that now also feed AI features: Google's AI Overviews and AI Mode build on Googlebot's index, and Microsoft Copilot builds on Bingbot's.
Blocking these removes you from both traditional rankings and the AI answers built on top of those indexes, usually the most costly block of all.
