AI crawler policy check
Paste a domain and see which AI crawlers your robots.txt blocks or allows - split into the retrieval bots that power citations (where blocking costs you visibility) and the training bots you may deliberately block.
Free and anonymous. Rate-limited to 20 checks per hour per IP. We fetch only /robots.txt.
Full report (JSON)
Crawler access is one of three agent-readiness pillars. Next: run the agent readiness check on a key page, or run the full free AI visibility audit to see whether engines actually cite you.