OpenAI bots
4 bots in the directory · Reviewed July 2026
OpenAI operates ChatGPT and runs three bots with strictly separated jobs: GPTBot collects training data, OAI-SearchBot builds the ChatGPT search index, and ChatGPT-User fetches pages live on user request. Each honors its own robots.txt token, so training and search visibility are independent decisions.
ChatGPT-User
Fetches pages in real time when a ChatGPT user asks about them or clicks a link in a conversation.
OAI-SearchBot
Builds the search index behind ChatGPT search. Not used for model training.
GPTBot
OpenAI's training crawler. It collects public web content that may be used to train future GPT models.
OAI-AdsBot
Validates the safety of web pages submitted as ads on ChatGPT.
Control every OpenAI bot at once
robots.txt lets one rule group target multiple user-agents. These snippets cover all 4 OpenAI tokens in this directory. For finer control, set rules per bot on each bot's page.
Allow all OpenAI bots
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: GPTBot
User-agent: OAI-AdsBot
Allow: /Block all OpenAI bots
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: GPTBot
User-agent: OAI-AdsBot
Disallow: /