AI-bot robots.txt audit

Check whether your robots.txt explicitly addresses ChatGPT, Claude, Gemini, Perplexity, and the 10+ other AI crawlers. Generates a copy-paste patch for the ones you're not covering.

Why a wildcard block isn't enough

Most AI crawlers explicitly document that User-agent: * alone doesn't opt content out of their training set — they require their vendor-specific UA to be named. GPTBot ignores the wildcard for training purposes. Google-Extended is a separate knob from Googlebot. Applebot-Extended is separate from Applebot. This tool audits each known AI UA individually and generates the exact directives you need.