xAI · Grok

GrokBot

Crawls the web for other xAI products. Here is how to recognise it, verify it, and allow or block it.

Company: xAI
Product: Grok
Why it visits: Other crawling
How to verify: Name only
User-agent contains: GrokBot

How to tell a real GrokBot from a fake

xAI publishes no IP list and no DNS names for GrokBot, so a visit can’t be proven real. Anyone can put “GrokBot” in a user-agent. Treat it as unverified, and watch how much it crawls.

Check a GrokBot visit

Allow or block GrokBot in robots.txt

Block it everywhere:

User-agent: GrokBot Disallow: /

Allow it everywhere:

User-agent: GrokBot Allow: /

Fake bots ignore robots.txt: block them by address in your firewall instead.