OpenAI bots

4 bots in the directory · Reviewed July 2026

OpenAI operates ChatGPT and runs three bots with strictly separated jobs: GPTBot collects training data, OAI-SearchBot builds the ChatGPT search index, and ChatGPT-User fetches pages live on user request. Each honors its own robots.txt token, so training and search visibility are independent decisions.

ChatGPT-User

Fetches pages in real time when a ChatGPT user asks about them or clicks a link in a conversation.

AI AssistantUser-triggered; robots.txt may not apply

OAI-SearchBot

Builds the search index behind ChatGPT search. Not used for model training.

AI SearchRespects robots.txt

GPTBot

OpenAI's training crawler. It collects public web content that may be used to train future GPT models.

AI TrainingRespects robots.txt

OAI-AdsBot

Validates the safety of web pages submitted as ads on ChatGPT.

Advertising

Control every OpenAI bot at once

robots.txt lets one rule group target multiple user-agents. These snippets cover all 4 OpenAI tokens in this directory. For finer control, set rules per bot on each bot's page.

Allow all OpenAI bots

User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: GPTBot
User-agent: OAI-AdsBot
Allow: /

Block all OpenAI bots

User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: GPTBot
User-agent: OAI-AdsBot
Disallow: /
← Back to the AI Bot Directory