GoogleOther

Operated by GoogleSearch EngineRespects robots.txt

Google's generic crawler for product teams: research and development fetches outside Search.

What GoogleOther does

GoogleOther is a generic crawler used by Google product teams for internal research and development crawls. Google documents it as separate from Googlebot, and it does not affect Search indexing.

Should I allow GoogleOther to crawl my site?

Blocking GoogleOther doesn't change Search or AI Overviews visibility. It mainly limits Google's non-Search product crawls of your content.

How to control GoogleOther

Target GoogleOther in your robots.txt with the GoogleOther token. Rules apply per bot, so you can allow this one while blocking others, or the reverse.

Allow GoogleOther

User-agent: GoogleOther
Allow: /

Block GoogleOther

User-agent: GoogleOther
Disallow: /

GoogleOther FAQ

What is GoogleOther?

GoogleOther is Google's generic crawler, used by various product teams to fetch publicly accessible content from sites, for example one-off crawls for internal research and development. Google documents it as a common crawler: it always respects robots.txt rules for automatic crawls, and crawling preferences addressed to it do not affect any specific Google product.

How do I block GoogleOther?

Add a robots.txt group with "User-agent: GoogleOther" followed by "Disallow: /" or a narrower path. Because rules addressed to GoogleOther do not affect any specific product, blocking it does not change how Googlebot crawls your site for Search. Note that the variants GoogleOther-Image and GoogleOther-Video have their own tokens and fall back to the GoogleOther token if theirs is absent.

About Search Engine Crawlers

Classic search indexers that now also feed AI features: Google's AI Overviews and AI Mode build on Googlebot's index, and Microsoft Copilot builds on Bingbot's.

Blocking these removes you from both traditional rankings and the AI answers built on top of those indexes, usually the most costly block of all.

More bots from Google

Google-Extended

Not a crawler: a robots.txt token that controls whether Google uses your content for Gemini training and grounding.

Googlebot

Google's main indexer: the crawl behind Search, AI Overviews, and AI Mode.

Google-Agent

Google agent that fetches pages on behalf of generative experiences.

Google-NotebookLM

Fetches sources a user adds to NotebookLM so it can summarize and cite them.

Google-CloudVertexBot

Crawls site-owner-requested pages to build Vertex AI Search agents.

Googlebot-Image

Indexes images for Google Image Search.

Googlebot-Video

Indexes video content for Google Video Search.

Googlebot-News

Indexes articles for Google News.

Storebot-Google

Crawls shopping content for all Google Shopping surfaces.

Chrome Lighthouse

Lighthouse page-experience and performance auditing.

AdsBot-Google-Mobile

Checks mobile ad landing-page quality for Google Ads.

AdsBot-Google

Checks ad landing-page quality for Google Ads.

Google-Display-Ads-Bot

Verifies site eligibility during the AdSense approval process.

Mediapartners-Google

Crawls participating sites to serve relevant AdSense/AdMob ads.

Google Stackdriver

Google Cloud uptime checks and availability monitoring.

Google-InspectionTool

Search Console URL Inspection and Rich Results Test.

Google-Safety

Abuse-specific crawling such as malware discovery.

Google Site Verifier

Fetches Search Console verification tokens.

Google Image Proxy

Image caching proxy used by Gmail and other Google services.

Chrome Prefetch Proxy

Fetches traffic-advice to enable privacy-preserving prefetch hints.

Google Feedfetcher

Crawls RSS/Atom feeds for Google News and PubSubHubbub.

Google Publisher Center

Fetches feeds publishers supply for Google News landing pages.

Google Read Aloud

Fetches and reads out web pages using text-to-speech on request.

APIs-Google

Delivers push-notification messages for Google APIs.

See which bots visit your site

Temso helps marketers track every AI crawler and bot that visits your site, and runs regular audits to make sure your website is always performing at its full potential.

Explore Website Audits
Website audit dashboard showing bot visits, citation-bot visits, and a table of AI bots crawling the site