Ai2 bots

2 bots in the directory · Reviewed July 2026

Ai2 operates 2 bots tracked in this directory. Each page below covers what the bot does and how to identify it.

AI2Bot

Crawls the web for content to train Allen Institute open-source AI models.

AI Training

SemanticScholarBot

Crawls academic PDFs for Semantic Scholar research discovery.

AI Training

Control every Ai2 bot at once

robots.txt lets one rule group target multiple user-agents. These snippets cover all 2 Ai2 tokens in this directory. For finer control, set rules per bot on each bot's page.

Allow all Ai2 bots

User-agent: AI2Bot
User-agent: SemanticScholarBot
Allow: /

Block all Ai2 bots

User-agent: AI2Bot
User-agent: SemanticScholarBot
Disallow: /

← Back to the AI Bot Directory