If AI crawlers can't reach you, AI search is less likely to cite you. Paste your domain and see in one click whether the crawlers behind ChatGPT, Claude, Perplexity, Gemini and more are allowed in by your robots.txt, or quietly shut out by it.
It reads your robots.txt only. A firewall, CDN bot setting or login can still block a crawler your robots.txt allows, so treat an "allowed" result as the first check, not the last.
Reads your public robots.txt, or the file you paste, nothing else. No signup. We do not save the addresses or files you check, and the site runs standard analytics like most sites. A free tool from Hawk Academy.
This crawler check reads your public robots.txt and tests it against the user-agents of 16 AI crawlers, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and the rest, the same crawler test each bot performs before fetching your pages. If a search or answer bot like OAI-SearchBot or PerplexityBot is blocked, retrieval, citation and AI traffic are off before they start. Blocking a training bot like GPTBot is different: it keeps your content out of model training, not out of ChatGPT search. Access is step one; step two is whether the bots can actually read your content once they arrive, which is what Can AI See Your Page? tests.
