If AI crawlers can't reach you, AI search is less likely to cite you. Paste your domain and see in one click whether the crawlers behind ChatGPT, Claude, Perplexity, Gemini and more are allowed in by your robots.txt, or quietly shut out by it.
It reads your robots.txt only. A firewall, CDN bot setting or login can still block a crawler your robots.txt allows, so treat an "allowed" result as the first check, not the last.
Reads your public robots.txt, nothing else. No login, nothing stored. A free tool from Hawk Academy.
This crawler check reads your public robots.txt and tests it against the user-agents of 16 AI crawlers, GPTBot, ClaudeBot, PerplexityBot, Google-Extended and the rest, the same crawler test each bot performs before fetching your pages. If a bot is blocked, everything downstream (retrieval, citation, AI traffic) is off before it starts. Access is step one; step two is whether the bots can actually read your content once they arrive, which is what Can AI See Your Page? tests.
