Apple bots
3 bots in the directory · Reviewed July 2026
Apple's Applebot crawls for Siri, Spotlight, and Safari suggestions. Training use for Apple's foundation models is controlled separately with the Applebot-Extended robots.txt token, so publishers can opt out of Apple Intelligence training without leaving Apple's answer surfaces.
Applebot-Extended
Not a crawler: a robots.txt token that opts your content out of Apple foundation model training.
Applebot
Apple's crawler for Siri, Spotlight, and Safari suggestions, and the fetch layer for Apple Intelligence.
Apple Podcasts
Accesses URLs for registered Apple Podcasts content.
Control every Apple bot at once
robots.txt lets one rule group target multiple user-agents. These snippets cover all 2 Apple tokens in this directory. For finer control, set rules per bot on each bot's page.
Allow all Apple bots
User-agent: Applebot-Extended
User-agent: Applebot
Allow: /Block all Apple bots
User-agent: Applebot-Extended
User-agent: Applebot
Disallow: /Careful: this group includes a search engine crawler. Blocking it removes you from traditional search rankings and the AI answers built on that index, not just AI features.