Allen Institute · Allen AI

AI2Bot

Collects pages to train Allen Institute’s AI models. Here is how to recognise it, verify it, and allow or block it.

Company: Allen Institute
Product: Allen AI
Why it visits: Collecting for AI training
How to verify: Name only
User-agent contains: AI2Bot

How to tell a real AI2Bot from a fake

Allen Institute publishes no IP list and no DNS names for AI2Bot, so a visit can’t be proven real. Anyone can put “AI2Bot” in a user-agent. Treat it as unverified, and watch how much it crawls.

Check a AI2Bot visit

Allow or block AI2Bot in robots.txt

Block it everywhere:

User-agent: AI2Bot Disallow: /

Allow it everywhere:

User-agent: AI2Bot Allow: /

Fake bots ignore robots.txt: block them by address in your firewall instead.